GCP Data Migration Lead

Full-time Computer Occupations

Role Name: GCP Data Migration Lead
Location: Chicago, IL - onsite

Contract Role


Job description:

Data Migration Lead

Design and build data pipelines: Develop and maintain reliable and scalable batch and real-time data

pipelines using GCP tools such as Cloud Dataflow (based on Apache Beam), Cloud Pub/Sub, and

Cloud Composer (for Apache Airflow).

Create and manage data storage solutions: Implement data warehousing and data lake solutions

using GCP products like BigQuery, Cloud Storage, and other transactional or NoSQL databases such

as Cloud SQL or Bigtable.

Ensure data quality and integrity: Develop and enforce procedures for data governance, quality

control, and validation throughout the data pipeline to ensure data is accurate and reliable.

Optimize performance and cost: Monitor data infrastructure and pipelines to ident...