Data Engineer

Description

We're currently seeking a Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics.

Requirements

• Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats
• Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities
• Practical knowledge of structural data formats including Parquet, JSON, and CSV
• Experience with orchestration tools, scheduling dependencies, and error handling in a cloud environment
• Familiarity with unit testing data pipelines and implementing automated data quality checks