Senior Data Engineer – PySpark, Python

D4 Insight

Full-time IT & Technology
Apply Now
Location
abu dhabi, abu dhabi emirate, United-Arab-Emirates
Posted
June 04, 2026

Job Description

Location: Dubai
Experience: 8+ Years
Work Mode: Hybrid (3 Days Onsite)

Role Overview:

We are seeking a highly experienced Senior Data Engineer with expertise in PySpark, Python, Hadoop, and large-scale data engineering pipelines .

The role involves building secure and scalable data platforms, enabling advanced analytics, and supporting machine learning workflows.

Key Responsibilities:

  • Acquire business requirements and perform exploratory data analysis (EDA).
  • Build scalable and high-performance data pipelines using Python, Spark, and Hadoop .
  • Perform feature engineering and support machine learning data workflows.
  • Collaborate with Data Scientists, Analytics teams, and stakeholders in Agile environments.
  • Optimize distributed data processing and ensure data quality and governance.

Required Skills:

  • Strong exper...