AI Automation Test Engineer with LLM

MSys Inc.

Full-time other-general
Apply Now
Location
United States, REMOTE,, United States
Posted
July 22, 2026

Job Description

**** Mode of Interview :- Webcam interview(1 Screening & 2 Technical Rounds) *** Long term project ***Linkedin Must***Remote***

Short Description :-

We are building AI-powered solutions including conversational AI, RAG systems, AI agents, and enterprise automation platforms. Join the AI Engineering team to test and optimize Generative AI, conversational AI, and RAG applications. Focus on AI quality, benchmarking, safety, observability, and automation to ensure production-ready systems.

Key Required Skills:-


+ Test Generative AI and conversational systems.

+ Perform LLM evaluation and benchmark testing.

+ Validate RAG (retrieval quality, relevance, grounding).

+ Build automation frameworks (Playwright/Selenium).

+ Conduct API, regression, and E2E testing.

+ Perform AI safety, red teaming, and bias validation.

+ Support observability, monitoring, and HITL workflows.

+ Coll...