C

Principal Data Engineer - AWS

Capco
On-site
London, United Kingdom
Data Engineer

Principal Data Engineer - AWS 
Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent

Engineer future-ready data platforms that power financial transformation.

The Role
We’re looking for a Principal Data Engineer with AWS to join our growing team of engineering experts driving next-gen transformation for Tier 1 financial services clients. You’ll play a pivotal role in designing, building, and deploying cloud-based data pipelines. Working across greenfield projects and enterprise-scale platforms, your work will directly impact the way data is ingested, transformed, and served at scale across the financial services industry.

What You’ll Do

  • Design and build end-to-end data pipelines leveraging AWS-native tools and modern data architectures.

  • Collaborate with clients to gather requirements, define solutions, and deliver production-grade systems.

  • Apply AWS Well-Architected Principles to ensure scalability, security, and resilience.

  • Lead in the development of robust, tested, and fault-tolerant data engineering solutions.

  • Support and mentor junior engineers, contributing to knowledge sharing across the team.

What We’re Looking For

  • Proficient in one of Python, Scala or Java, with strong experience in Big Data technologies such as: Spark, Hadoop etc.

  • Practical knowledge of building real-time event streaming pipelines (e.g., Kafka, Spark Streaming, Kinesis).

  • Proficiency in AWS cloud environments.
  • Proven experience developing modern data architectures including Data Lakehouse and Data Warehousing.
  • A solid understanding of CI/CD practices, DevOps tooling, and data governance including GDPR.

Bonus Points For

  • Expertise in Data Modelling, schema design, and handling both structured and semi-structured data.

  • Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks.

  • Exposure to AWS Lake Formation and automation of ingestion and transformation layers.

  • Background in delivering solutions for highly regulated industries.

  • Passion for mentoring and enabling data engineering best practices across teams.

Why Join Capco

  • Deliver high-impact technology solutions for Tier 1 financial institutions

  • Work in a collaborative, flat, and entrepreneurial consulting culture

  • Access continuous learning, training, and industry certifications

  • Be part of a team shaping the future of digital financial services

  • Help shape the future of digital transformation across FS & Energy

We offer a competitive, people-first benefits package designed to support every aspect of your life:

  • Core Benefits: Discretionary bonus, competitive pension, health insurance, life insurance and critical illness cover.

  • Mental Health: Easy access to CareFirst, Unmind, Aviva consultations, and in-house first aiders.

  • Family-Friendly: Maternity, adoption, shared parental leave, plus paid leave for sickness, pregnancy loss, fertility treatment, menopause, and bereavement.

  • Family Care: 8 complimentary backup care sessions for emergency childcare or elder care.

  • Holiday Flexibility: 5 weeks of annual leave with the option to buy or sell holiday days based on your needs.

  • Continuous Learning: Minimum 40 Hours of Training Annually: Take your pick—workshops, certifications, e-learning—your growth, your way. Also, Business Coach assigned from Day One: Get one-on-one guidance to fast-track your goals and accelerate your development.

  • Healthcare Access: Convenient online GP services.

  • Extra Perks: Gympass (Wellhub), travel insurance, Tastecard, season ticket loans, Cycle to Work, and dental insurance.

Inclusion at Capco
We’re committed to a barrier-free, inclusive recruitment process. If you need any adjustments at any stage, just let us know – we’ll be happy to help. We welcome applicants from all backgrounds. At Capco, we value the difference you make, and the differences that make you. Our #BeYourselfAtWork culture champions diversity, equity and inclusivity, and we bring a collaborative mindset to our partnerships with clients and colleagues. #BeYourselfAtWork is the cornerstone of our success and a value that our employees live and breathe every day.