Job Description
Job Title: Senior Data Engineer – Core Team (Onshore)
Program: Symphony
Client: The Coca-Cola Company (TCCC)
Engagement Type: Contract
Model: Core Team
Location: Remote
Start Date: ASAP
Duration: Ongoing (Quarterly renewal)
Day to Day Job Duties:
•Migrate Spark Job Definitions from Synapse to Fabric (32)
Design, develop, and maintain data pipelines using Scala and SQL on Apache Spark.
• Monitor and support Phase 1 pipelines post go-live.
• Investigate and remediate pipeline failures, data quality issues, and performance bottlenecks.
• Lead refactoring and cleanup of existing Phase 1 code.
• Optimize existing solutions for performance and scalability.
• Build and contribute to reusable patterns and automation frameworks.
• Work within TCCC’s metadata-driven architecture.
• Ensure pipelines are used strictly for scheduling — ETL logic must remain in code.
• Manage code using GitHub version control...