Data Engineer with Databricks

Full-time Computer Occupations

<p><b>Job Description:</b></p> <div> </div> <div> <ul> <li> <p>Design, develop, and maintain scalable batch data pipelines using Apache Spark on Azure Databricks.</p> </li> <li> <p>Work on Spark repositories, implementing new features and enhancements.</p> </li> <li> <p>Use Git for day-to-day development (branching, committing, merging, pull requests).</p> </li> <li> <p>Build Spark executable JARs using Maven and manage dependencies.</p> </li> <li> <p>Execute and validate Spark jobs using Spark Submit on Azure Databricks with custom runtime arguments and I/O paths.</p> </li> <li> <p>Configure, orchestrate, and monitor Databricks Workflows, Jobs, and Pipelines for reliable batch execution.</p> </li> <li> <p>Implement and manage Delta Lake components (Delta Tables, Delta Live Tabl...