Datahead logo

Senior Data Engineer

Datahead
On-site
London, United Kingdom
Data Engineer

About the job

Only apply if you have Insurance background

We are looking for a Senior Data Engineer to spearhead the migration of underwriting data from various systems into a robust Azure Cloud Lakehouse. This is a hands-on role, leveraging Azure Synapse Analytics and PySpark, where you'll play a key part in delivering transformative data engineering solutions.

About the Role

As a Senior Data Engineer, you will:

  • Lead the migration of underwriting data from multiple systems into an Azure Cloud Lakehouse environment.
  • Utilise PySpark within Azure Synapse Analytics to develop scalable data pipelines and processing frameworks.
  • Design and implement robust data engineering solutions, creating a single version of truth for data analytics and reporting.
  • Develop self-service reporting capabilities using Power BI, enabling business users to access actionable insights.
  • Establish and uphold global standards for data engineering design and delivery within the Microsoft ecosystem.

Key Responsibilities

  • Build, optimise, and maintain data pipelines in Azure Synapse.
  • Collaborate with cross-functional teams to ensure seamless integration and transformation of underwriting data.
  • Lead the creation of intuitive Power BI reports and dashboards, selecting visualisations that support decision-making.
  • Drive the adoption of a data-driven culture across the organisation, enabling data accessibility for all users.

Required Skills & Experience

  • Extensive experience with the Microsoft tech stack, particularly Azure Synapse Analytics, Data Factory, and Databricks.
  • Strong programming skills in PySpark, SQL, and familiarity with DAX.
  • Proven track record of leading data migration projects, ideally within a lakehouse environment.
  • Experience with data visualisation and report development using Power BI.
  • Excellent communication, stakeholder management, and problem-solving skills.

Please apply!