Job Description
Req ID: 375787
We are currently seeking a Data Engineer - Fabric Pipelines / Orchestration to join our team in Delhi, Delhi (IN-DL), India (IN).
Job Title: Data Engineer – Core Team (Offshore)
Program: Symphony
Client: The Coca-Cola Company (TCCC)
Engagement Type: Contract
Model: Core Team
Location: Remote
Start Date: ASAP
Duration: Ongoing (Quarterly renewal)
Day to Day Job Duties:
•Migrate Spark Job Definitions from Synapse to Fabric (32)
Build Fabric Pipelines; Set up Data Orchestration
Design, develop, and maintain data pipelines using Scala and SQL on Apache Spark.
• Monitor and support Phase 1 pipelines post go-live.
• Investigate and remediate pipeline failures, data quality issues, and performance bottlenecks.
• Lead refactoring and cleanup of existing Phase 1 code.
• Optimize existing solutions for performance and scalability.
• Build and contribute to reusable patterns and ...