Lead Data Engineer

Howden
London, England, United Kingdom
Full Time
On Site
Senior
0+
Data & Analytics Information Technology Telecommunications

Posted 5 days ago

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7

Job summary

Lead Data Engineer responsible for designing and delivering scalable metadata-driven data solutions using Databricks and Azure services, leading technical discussions, mentoring junior engineers, and collaborating with stakeholders to implement high-impact data initiatives.

Responsibilities

Lead the design and delivery of scalable metadata ingestion frameworks, orchestration processes, and data pipelines using Databricks and Azure services. Establish engineering, CI/CD, governance, and security best practices while optimizing existing solutions, collaborating with stakeholders, and mentoring junior engineers.

Qualifications

Azure Data Factory (ADF) Azure Data Lake Storage (ADLS) Azure data services CI/CD practices Databricks metadata-driven pipelines orchestration PySpark software engineering best practices Terraform, Bicep, ARM templates

Candidates need 8+ years of data engineering experience, strong Databricks SQL and PySpark expertise, and extensive experience with Azure data services and metadata-driven pipelines. They should also bring orchestration, CI/CD, software engineering, and stakeholder leadership experience; infrastructure as code and insurance data experience are preferred.

English

Company

Howden

Howden

linkedin
Insurance
Location
London, England, United Kingdom

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7
Pete DeQuarto avatar
Pete DeQuarto

AIApply is a total game-changer. Thanks to Auto-Apply, I have been applying to jobs I would never even have come across otherwise!

Akarshak Tanwar avatar
Akarshak Tanwar

In one week I applied to over 150 jobs and locked in 2 confirmed interviews, with a support team that was quick to respond. The auto-apply feature is fascinating and a real pleasure to use!

JC
Julian Carlin

It really worked. In under 48 hours it had applied to 100 jobs on my behalf without any time or effort from me. I am looking forward to seeing how it keeps improving.