Job Description
We are seeking a skilled Databricks Developer to design, develop, and optimize scalable data pipelines and analytics solutions using Apache Spark, Python (PySpark), and SQL within modern cloud environments. The ideal candidate will have hands-on experience working with Databricks, Delta Lake, and cloud data platforms, and will be responsible for building high-performance data processing workflows that support data-driven decision-making.
Key Responsibilities
Pipeline Development
Design, develop, and maintain ETL/ELT data pipelines using PySpark and SQL in Databricks notebooks.
Process large-scale datasets and ensure reliable and efficient data transformations.
Architecture Design
Implement data lake and data warehouse architectures using Databricks Delta Lake and Delta Live Tables.