Data Engineer

full-time Computer Occupations

Job Description

We’re looking for an experienced Data Engineer to join our growing Machine Learning team.Your work will entail the following :

• Creating data flows
• Working on data versioning
• Launching flows in orchestration tools
• Improve CI/CD pipelines
• Dependencies management (poetry)
• Deploying scripts/models created by data scientists on Notebooks

Qualifications

• 3-5 years of experience
• Proficiency with Python
• Experience with distributed systems to manipulate big data (Dask, Spark)
• Experience with ML datasets is a plus
• Experience creating ETL pipelines
• Experience working with GCP (Google Cloud Platform) on main data services (cloud storage, bigquery, cloud build, GKE..)
• Experience using orchestrators (airflow, dagster...)
• Work environment (Linux, Jupyter, Python, Git, Docker, SQL, NoSQL, ...)
• Significant experience with Pandas...