Job Description
Data Engineer
Location ā Northern Ireland (Belfast) If based in the UK candidates must be willing to frequently travel to Northern Ireland.
Contract ā 6 Months
Day rate ā Ā£500 (Inside IR35)
Ā
Your responsibilities in the role
Ā
- Design and implement efficient data ingestion pipelines to and from databases and file storage services.
- Transform data from source to target to ensure data quality and consistency, based in agreed specifications.
- Build, maintain and optimise data pipelines to automate data flows and enable real time data processing.
- Monitor data quality and implement measures to ensure data accuracy and completeness.
- Manage and maintain databases to ensure optimal performance and security.
- Deploy and manage data infrastructure on cloud platforms ā primarily AWS
- Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.
Ā
Skills and Experience
Ā
- AWS focused, Ideally a AWS Certified Data Engineer.
- SQL, Python, and Spark and experience with metadata-driven ETL/ELT.
- AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight.
- Version Control (Gitlab), CI/CD and IaC.
- Familiar with security and networking principles, especially in AWS deployment.
- Experience and understanding of handling both structured and unstructured data.
- Complex data migrations.
- Strong problem-solving analytical skills.
- Excellent communication and collaboration skills.
- Understanding of GIS data models.
Ā
Further information is required upon application