Python and PySpark Developer

Full-time Other-General

Python, Pyspark Developer Technology->Analytics - Packages->Python - Big Data,Technology->Big Data - Data Processing->PySpark • Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent practical experience). • 5–9 years of hands-on experience in software development and/or data engineering roles. • Strong proficiency in Python with experience building production-grade applications or data workflows. • Strong proficiency in PySpark, including DataFrame APIs, optimization techniques, and distributed processing concepts. • Working knowledge of SQL for complex queries, data analysis, and validation. • Experience delivering reliable solutions with attention to performance, scalability, and maintainability. • Design, develop, and maintain scalable batch/stream data pipelines using Python and PySpark in distributed environments. • Implement efficient transformations, aggregations, and joins on large datasets while ensuring performance and cost optimization. • Writ...