Data Engineer – Unity Catalog Migration
Innova ESI
Full-time
automation,azure,data,embedded,end-to-end,engineering,performance
Location
bengaluru, karnataka, India
Posted
June 23, 2026
Job Description
Role: Data Engineer – Unity Catalog Migration
Location: Gurgaon
Experience: 5+ Years
Immediate Joiners
Senior Data Engineer - Unity Catalog Migration
- 5-8+ years in data engineering with proven large-scale migration experience (500+ notebooks minimum)
- Strong hands-on PySpark proficiency including RDD operations, DataFrame/Dataset APIs, and performance optimization
- Deep Unity Catalog migration experience : Hive metastore to UC, mount-to-volume patterns, RBAC implementation
- Testing : Perform end-to-end validation of Unity Catalog migrated notebooks, tables, volumes, and data pipelines to ensure functional correctness and data integrity.
- Hands-on experience with Azure Databricks, UCX tool, and Azure Data Factory orchestrat...