Senior Data Engineer – PySpark, Python

D4 Insight

Full-time IT & Technology
Apply Now
Location
dubai, dubai, United-Arab-Emirates
Posted
June 04, 2026

Job Description

Role Overview

We are seeking a highly experienced Senior Data Engineer with expertise in PySpark, Python, Hadoop, and large-scale data engineering pipelines. The role involves building secure and scalable data platforms, enabling advanced analytics, and supporting machine learning workflows.

Location: Dubai | Experience: 8+ Years | Work Mode: Hybrid (3 Days Onsite)

Key Responsibilities

  • Acquire business requirements and perform exploratory data analysis (EDA).
  • Build scalable and high-performance data pipelines using Python, Spark, and Hadoop.
  • Perform feature engineering and support machine learning data workflows.
  • Collaborate with Data Scientists, Analytics teams, and stakeholders in Agile environments.
  • Optimize distributed data processing and ensure data quality and governance.

Required Skills

  • Strong expertise in Python, PySpark, Spark optimization, Hadoop, and SQL. <...