Software Engineer (Apache Beam) - Remote work | REF#288579

Full-time Desenvolvimento de software

Software Engineer (Apache Beam) at BairesDev

As a Software Engineer specializing in Apache Beam, you will develop sophisticated data pipelines using a unified model for both batch and stream processing. You will align complex data processing requirements with scalable infrastructure, ensuring efficient and reliable data orchestration across the Apache ecosystem.

What You’ll Do

• Design and implement scalable data pipelines using the Apache Beam unified model for batch and stream processing.
• Deploy and optimize data processing jobs on execution engines such as Google Cloud Dataflow or Apache Flink.
• Develop transformational logic to handle complex data streams and large-scale batch datasets efficiently.
• Ensure the performance, reliability, and cost-effectiveness of unified data processing workflows.
• Collaborate with data teams to define requirements for real‑time analytics and historical data processing.
...