Data Quality Engineer

Full-time Engineering

We are looking for an experienced Data QA Automation Engineer to design and implement a scalable quality assurance framework for cloud-native data platforms. The role focuses on automating testing for batch and real-time data pipelines, ensuring data quality, reliability, and performance through Python-based frameworks, CI/CD integration, and modern data validation tools across the Azure ecosystem.

Key Responsibilities:

• Design and develop automated QA frameworks for batch and real-time data pipelines.
• Build reusable unit, integration, regression, and API test frameworks for ETL workflows.
• Implement automated data quality validation using tools like Great Expectations, Deequ, or Soda Core.
• Integrate automated testing into CI/CD pipelines using Azure DevOps, GitHub Actions, or Jenkins.
• Embed data quality gates into orchestration platforms such as Azure Data Factory or Airflow.
• Validate data tr...