Skip to main content
T

GCP Data Engineer

Tcs Uk
1 day ago
Contract
On-site
London, United Kingdom
Β£350 - Β£400 GBP hourly
Data Engineer

The Role

We are seeking an experienced GCP Data Engineer to design, build, and optimize scalable cloud-native data platforms on Google Cloud Platform (GCP). The ideal candidate will have strong expertise in developing batch and real-time data pipelines, implementing data lake and data warehouse solutions, and enabling data-driven analytics and AI/ML initiatives. The role involves close collaboration with architects, data scientists, business analysts, and application teams to deliver high-quality, secure, and reliable data solutions

Your responsibilities:

β€’ Build batch and streaming data ingestion frameworks using Dataflow, Dataproc, Pub/Sub, and Cloud Functions.

β€’ Develop reusable and optimized data processing solutions using PySpark and Python.

β€’ Implement orchestration workflows using Cloud Composer (Apache Airflow).

β€’ Ensure data quality, integrity, lineage, and governance across data platforms.

β€’ Implement partitioning, clustering, and performance tuning strategies in BigQuery.

β€’ Manage structured, semi-structured, and unstructured data processing requirements.

β€’ Implement IAM policies, data security controls, and compliance requirements.

β€’ Participate in technical design discussions, code reviews, and solution governance meetings.

Your Profile

Essential skills/knowledge/experience:

β€’ Google Cloud Platform (GCP)

β€’ BigQuery

β€’ Dataproc

β€’ Cloud Composer (Airflow)

β€’ Pub/Sub

β€’ Dataflow

β€’ Cloud Storage

β€’ Python

β€’ PySpark

β€’ SQL

β€’ Terraform

β€’ Git, CI/CD

Desirable skills/knowledge/experience:

β€’ Strong analytical and problem-solving skills.

β€’ Excellent communication and stakeholder management capabilities.

β€’ Ability to work in global and multi-vendor environments.

β€’ Experience delivering solutions for data modernization and cloud migration initiatives.