Location
Minneapolis, MN, United States
Posted
July 11, 2026
Job Description
The Sr. AI Test Engineer is responsible for designing, building, and running the tests that prove AI systems behave as intended in production. Working under the direction of the AI Test Lead Architect, this role translates testing methodology into working test suites, evaluation harnesses, and quality gates for deterministic and non-deterministic systems (ML models, GenAI, and LLM applications).
The role is cloud-native by design: AI workloads are tested where they run, requiring deep expertise in one major cloud platform—AWS (SageMaker, Bedrock), GCP (Vertex AI), or Azure (Azure ML, Azure OpenAI)—with quality embedded directly into CI/CD and MLOps pipelines. The engineer partners closely with data scientists, ML engineers, and product teams to shift quality left and catch model, data, and behavioral issues before they reach users.
While this is a senior individual-contributor role, the Sr. AI Test Engineer is expected to mentor other testers, set technical standards for AI qua...
The role is cloud-native by design: AI workloads are tested where they run, requiring deep expertise in one major cloud platform—AWS (SageMaker, Bedrock), GCP (Vertex AI), or Azure (Azure ML, Azure OpenAI)—with quality embedded directly into CI/CD and MLOps pipelines. The engineer partners closely with data scientists, ML engineers, and product teams to shift quality left and catch model, data, and behavioral issues before they reach users.
While this is a senior individual-contributor role, the Sr. AI Test Engineer is expected to mentor other testers, set technical standards for AI qua...