Senior Data Engineer

Description

Infinigate Group is seeking a Senior Data Engineer to join our innovative AI & Data team in a dynamic and fast-paced environment. This is an exciting opportunity to collaborate with a motivated team where teamwork, innovation, and personal development are core to everything we do. You’ll work with industry-leading platforms such as Databricks and Microsoft Fabric to build cutting-edge data solutions. 

The successful candidate for this role will design, build, and operate scalable, high-performance data platforms that power analytics, reporting, and machine learning initiatives across the business. You will take ownership of end-to-end data pipeline architecture, from ingestion through to curated, business-ready data products, while establishing best practices for reliability, quality, governance, and cost efficiency. 

We are pleased to offer this permanent position on a hybrid basis, based form any of our 4 UK offices – London, Woking, South Cerney and Fareham.

Requirements

Software Knowledge 

• Experience using Databricks 
• Solid SQL and Python skills – able to use the Python programming concepts in Databricks Notebooks for data loading, transformation and exploration including familiarity with Pandas  
• Strong understanding of core Databricks and Spark concepts such as Delta Live Tables, Delta Sharing, Medallion Architecture, Dataframes, Workflows, Unity Catalogue, Delta Live Tables, and UDF’s  
• Understand of databricks lakeflow connect, lakebase, metric views, genie etc  
• Understands the key principals of Data Warehouse design including Star Schema, F&D design, Dimension and Fact loading patterns, SCD and CDC concepts   
• Experience with use of MS DevOps for Scrum management and with Repos and use of CI / CD Pipelines between Azure and DevOps  
• Experience of using AI development tools such as cursor  
• Proven track record in a data engineering role where the focus has been on developing data pipelines, data warehouses, data lakehouses, and similar data repositories for BI, Reporting and Analytics use  

   Certifications (Nice to Have) 

• MSc Data Science or equivalent  
• Any relevant Azure certifications / exams such as: AZ-900, DP-900, DP-203, or DP-500    
• Any relevant Databricks certifications: Lakehouse Data Engineer Associate, : Lakehouse Data Engineer Professional  

Personal requirements 
Infinigate’s values underpin a strong collaborative working culture and successful inclusive working environment. 

• Own it! Owns the ability to quickly learn new data tools and ideas with exceptional analytical abilities  
• Aim high! Capable of analysing and troubleshooting complicated data sets hunting for a solution  
• Be open! A self-starter with outstanding interpersonal skills