Bigdata developer

Lorven Technologies Inc.

Full-time IT & Technology
Apply Now
Location
toronto, on, Canada
Posted
July 20, 2026

Job Description

Location: Toronto 4 days a week on site F2F interview required

Role Overview

We are looking for a Senior Backend Developer with 5+ years of experience in big data engineering, API integration, and AI-assisted development. The ideal candidate will design, build, and maintain scalable data pipelines and backend systems in an enterprise environment.

Key Responsibilities

  • Design and develop Spark‑Scala applications for large‑scale data processing on Hadoop/CDP clusters
  • Build and optimize ETL/ELT pipelines using Spark DataFrames, Datasets and Spark SQL
  • Tune Spark jobs for performance (partitioning, caching, broadcast joins, shuffle optimization)
  • Migrate Spark 2 applications to Spark 3 on Cloudera CDP platforms
  • Work with Parquet, ORC, Avro file formats on HDFS
  • Write complex HiveQL / Spark SQL queries including window functions, CTEs, subqueries and ...