Software Development Engineer II, AWS Analytics - Spark Engine
Amazon Development Center U.S., Inc.
full-time
Computer Occupations
Location
Palo Alto, California, United States
Posted
July 02, 2026
Job Description
The Open Data analytics team is looking for an experienced engineer to join the Spark engines team.
EMR, Glue ETL and Athena are services that our customer use to run large scale analytics, leveraging open source engines like Spark. The analytic engine organization makes significant modifications to these engines to run in EKS, EC2, Serverless environments and with superior performance and scalability than what is available in Open Source. In the last 3 years we have improved our engines by a factor of 5x by making changes to the optimizer, query runtime and storage connectors. We have also made significant changes to the compiler to enable enterprise features like fine grain access control. We have built integration frameworks and AI based automations to improve our efficiency in delivery value to our customer faster. This is a “must-win” strategic area in a growing and very technical space.
We are looking for a hands-on engineer to help us improve the Spark engine f...
EMR, Glue ETL and Athena are services that our customer use to run large scale analytics, leveraging open source engines like Spark. The analytic engine organization makes significant modifications to these engines to run in EKS, EC2, Serverless environments and with superior performance and scalability than what is available in Open Source. In the last 3 years we have improved our engines by a factor of 5x by making changes to the optimizer, query runtime and storage connectors. We have also made significant changes to the compiler to enable enterprise features like fine grain access control. We have built integration frameworks and AI based automations to improve our efficiency in delivery value to our customer faster. This is a “must-win” strategic area in a growing and very technical space.
We are looking for a hands-on engineer to help us improve the Spark engine f...