Job Description
:
Key Responsibilities:
Data Engineering & Architecture:
Design, develop, and maintainĀ high-performance data pipelinesĀ for structured and unstructured data usingĀ Azure Data BricksĀ andĀ Apache Spark. Build and manage scalableĀ data ingestion frameworksĀ for batch and real-time data processing. Implement and optimizeĀ data lake architectureĀ inĀ Azure Data LakeĀ to support analytics and reporting workloads. Develop and optimizeĀ data modelsĀ and queries inĀ Azure Synapse AnalyticsĀ to power BI and analytics use cases. Cloud-Based Data Solutions:
Architect and implement modernĀ data lakehousesĀ combining the best of data lakes and data warehouses. LeverageĀ Azure servicesĀ likeĀ Data Factory,Ā Event Hub, andĀ Blob StorageĀ for end-to-end data workflows. Ensure security, compliance, and governance of data throughĀ Azure Role-Based Access Control (RBAC)Ā andĀ Data Lake ACLs. ETL/ELT Devel...