Software Development Manager - AWS Glue, Glue and GenAI for Data Processing
Amazon
Full-time
other-general
Location
East Palo Alto, CA, United States
Posted
June 08, 2026
Job Description
Description
Are you a technical leader who wants to build AI agents that solve real problems for data engineers at scale?
We're hiring a Software Development Manager to lead a team building agentic AI systems across AWS Glue, Amazon EMR, and Amazon Athena — some of AWS's largest analytics services, powering hundreds of thousands of customers worldwide.
What You'll Own:
Spark Upgrade & Migration Agents
Our agentic AI turns 6-12 month Spark version upgrades into weeks — through automated code transformation, conversational interfaces, and rigorous data quality validation. Enterprise customers are already using it across hundreds of workloads. We're expanding into broader SQL migration across AWS Analytics services (Athena, SparkSQL, Redshift) over the next 2-3 years.
Learn more: https://aws.amazon.com/blogs/big-data/introducing-apache-spark-upgrade-agent-for-amazon-emr/
Managed Analytics MCP Service
A fully managed Model Context Proto...
Are you a technical leader who wants to build AI agents that solve real problems for data engineers at scale?
We're hiring a Software Development Manager to lead a team building agentic AI systems across AWS Glue, Amazon EMR, and Amazon Athena — some of AWS's largest analytics services, powering hundreds of thousands of customers worldwide.
What You'll Own:
Spark Upgrade & Migration Agents
Our agentic AI turns 6-12 month Spark version upgrades into weeks — through automated code transformation, conversational interfaces, and rigorous data quality validation. Enterprise customers are already using it across hundreds of workloads. We're expanding into broader SQL migration across AWS Analytics services (Athena, SparkSQL, Redshift) over the next 2-3 years.
Learn more: https://aws.amazon.com/blogs/big-data/introducing-apache-spark-upgrade-agent-for-amazon-emr/
Managed Analytics MCP Service
A fully managed Model Context Proto...