Data Engineer

, United Kingdom

Job Family Group:

Information Technology (IT)

Worker Type:

Regular

Posting Start Date:

March 23, 2026

Business Unit:

Projects and Technology

Experience Level:

Experienced Professionals

Job Description:

Typically:
• Manages key elements of one or more data engineering projects. Team member in defining and builds the data pipelines that will enable faster, better, data-informed decision-making within the business. Supports the implementation of a new big data solution which supports high amounts and velocity of data and supports future growth. Works with latest developments, testing and deployment techniques to support the deployment of new releases to e.g. deploy new data pipelines and add data sources. Delivers on responsibilities for Sprint deliverables, when required.
• Guides stakeholders in understanding analyses / outcomes and using them. Helps the business to find the right answer to solve their business problems, to determine feasible solutions contributing to develop new business models. Influential at team level through oral presentations, business cases and investment proposals.
• Supports stakeholders by gathering, analysing and modelling data and key performance indicators of moderate to high complexity. Working as a key member of a Team to develop and deploy innovative big data platforms for advanced analytics and data processing.
• Works under broad guidance and supervision by Manager / Team Lead for complex activities.

This job profile contains generic information and does not describe individual positions or required job competencies. Grading decisions will also depend on other factors.

-

Education

• University degree in any IT discipline
• Minimum 5+ years of experience in the IT industry

Expected Skills

• Proven technology champion in working with relational, Data warehouses databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience/Knowledge in working with NoSQL databases and can create E2E pipelines.
• Experienced in building and optimizing complex queries. Good with manipulating, processing and extracting value from large, disconnected datasets.
• Proven Experience in working with any one of the data engineering technologies like ADLS, ADF, Azure Databricks, Azure SQL, Synapse, SAP HANA, AWS. Your experience in handling big data sets and big data technologies will be an asset.
• Proven champion with in-depth knowledge of any one of the scripting languages: Python, SQL, Spark-SQL/ PySpark.
• Very Good understanding in Data Foundation initiatives, like Modelling, Data Quality Management, Data Governance, Data Maturity Assessments and Data Strategy in support of the key business stakeholders.
• Experience in working with AGILE, KANBAN methodologies. Able to run a sprint.
• Communication Skills to engage both technical developers, Architects, and stakeholders.

Nice to Have Skills

• Gas/Power Trading knowledge - Short-term trading, physical assets trading (CCGT, Wind, Solar, Battery)
• Risk - Modelling & understanding of risk & risk management.
• Quantitative Skills - Statistical methods to check and investigate numerical data for practical insights.
• Commodity Modelling - Energy (power, gas, environmental products) and meteorology.
• Previously created or enhanced CI/CD build and releases pipelines.
• Experience in working with scripting languages such as YAML, PowerShell, Terraform etc.
• Experience with big data tools: Kafka, Hadoop, Spark and similar technologies. Experience with stream-processing systems
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow and more.
• Core Python skills like: Numpy, Panda, Django

Certification in Azure

DISCLAIMER:

Please note: We occasionally amend or withdraw Shell jobs and reserve the right to do so at any time, including prior to the advertised closing date. Before applying, you are advised to read our data protection policy. This policy describes the processing that may be associated with your personal data and informs you that your personal data may be transferred to Shell/Shell Group companies around the world. The Shell Group and its approved recruitment consultants will never ask you for a fee to process or consider your application for a career with Shell. Anyone who demands such a fee is not an authorised Shell representative and you are strongly advised to refuse any such demand. Shell is an Equal Opportunity Employer.