AWS Data Engineer

AWS Data Engineer

Contract: 6 Months Rate: £400 per day IR35 Status: Outside IR35 Location: Remote / Hybrid

Overview

We are seeking an experienced AWS Data Engineer to join a growing consultancy on an initial 6-month contract. You'll be responsible for designing, building, and optimising modern data platforms and pipelines, enabling analytics, reporting, and AI-driven initiatives across the business.

This role is ideal for someone with strong AWS experience and a background working with modern data tooling including dbt, PySpark, Airflow, Redshift, Iceberg, OpenSearch, Knowledge Graphs, Python, and CircleCI .

Key Responsibilities

• Design and develop scalable ETL/ELT data pipelines using Python and PySpark

• Build and maintain data transformation frameworks using dbt

• Develop and orchestrate workflows using Apache Airflow

• Deliver high-performance data warehouse solutions within Amazon Redshift

• Support the implementation and optimisation of Apache Iceberg lakehouse architectures

• Develop and enhance search capabilities using OpenSearch

• Work with Knowledge Graph technologies to improve data discovery and relationships

• Implement CI/CD best practices using CircleCI

• Collaborate with Data Analysts, Product Teams, and Business Stakeholders to deliver high-quality data solutions

• Ensure data quality, reliability, governance, and scalability across the platform Required Experience

• Strong commercial experience as a Data Engineer within AWS

• Expertise in Python , SQL , and PySpark

• Hands-on experience with dbt

• Strong experience managing workflows with Apache Airflow

• Experience with Amazon Redshift

• Knowledge of modern data lakehouse architectures, including Apache Iceberg

• Experience with OpenSearch / Elasticsearch technologies

• Exposure to Knowledge Graphs and graph-based data modelling

• Experience implementing CI/CD pipelines using CircleCI

• Strong understanding of data modelling, performance optimisation, and engineering best practices Desirable

• Experience with AWS services such as S3, Lambda, Glue, ECS, EKS, or EMR

• Experience supporting AI, machine learning, or advanced analytics use cases

• Infrastructure as Code experience (Terraform preferred)

• Experience working within Agile delivery environments