Job Description
About the Role
We are looking for a Streaming Data Engineer to design and build scalable real-time data pipelines and streaming data platforms. This role focuses on building high-throughput, low-latency data systems capable of processing large-scale event streams and enabling real-time analytics.
Key Responsibilities
1. Design and develop real-time streaming data pipelines
2. Build event ingestion systems using Kafka or similar messaging systems
3. Implement stream processing jobs using Flink / Spark Streaming
4. Develop scalable stream processing jobs
5. Build and optimize real-time analytical databases
6. Build and maintain data pipelines supporting both batch and streaming workloads
7. Support real-time dashboards and data APIs
8. Implement monitoring and alerting for streaming pipelines
9. Work closely with Data Scientists, Data Analysts, Backend Engineers, and Platform Engineers
<...