Lead Data Engineer

Lead Data Engineer

Location: Leeds (Mostly Remote – 1 Day On-Site)
Salary: Up to £75,000 per annum

Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our team based in Leeds, working mostly remotely with just one day on-site per week.

You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices.

About You

You might currently be a Senior Data Engineer ready to grow your leadership skills. You’re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment.

Key Responsibilities

• Lead development of data pipelines and solutions using Databricks, Python, and SQL

• Design and maintain data models supporting analytics and business intelligence

• Build and optimise ELT/ETL processes on AWS or Azure

• Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products

• Champion best practices in testing, CI/CD, version control, and infrastructure as code

• Mentor and support your team, taking ownership of technical delivery and decisions

• Drive continuous improvements in platform performance, cost, and reliability

Key Requirements

• Hands-on experience with Databricks or similar data engineering platforms

• Strong Python and SQL skills in data engineering contexts

• Expertise in data modelling and building analytics-ready datasets

• Experience with AWS or Azure cloud data services

• Proven leadership or mentorship experience

• Excellent communication and stakeholder management

• Agile delivery and DevOps tooling knowledge

Desirable

• Experience with infrastructure-as-code (Terraform, CloudFormation)

• Familiarity with CI/CD pipelines and orchestration tools

• Knowledge of data governance and quality controls

• Experience in regulated or large-scale environments