Job Description
What you’ll do:
• Design, build and maintain data processing ETL pipelines & data products in a multi-cloud, multi-region, distributed processing context choosing the right technologies.
• Drive data investigations to deliver a resolution of technical, procedural, and operational issues.
• Solve complex business problems by utilizing disciplined development methodology, producing scalable, flexible, efficient and supportable solutions using appropriate technologies.
Skills:
Data engineering patterns: Sound knowledge of the different data engineering patterns to determine what to use and when
Data architecture: Understanding of data architecture and frameworks like Data mesh, data fabric etc.
Big Data Technologies: Proficiency in big data technologies such as data lake, EMR, Glue for analysing large datasets.
Programming Languages: Proficiency in programming languages commonly used in data engineering, such as Python, Java, or Scala. with...