Databricks Data Engineer

Data Engineer (Databricks / Azure) – Insurance Data Platform A fast-growing, technology specialist insurer in the Lloyd's market is looking for a Data Engineer with strong Databricks and Azure Data Factory experience to build and run the pipelines powering its central data platform, which underpins pricing, underwriting, risk selection and AI initiatives across the business. The successful applicant will own pipelines end to end, from ingesting data from files, APIs and databases through to curated, well-modelled datasets consumed by analysts, actuaries and data scientists via Power BI and Databricks. You'll design fact and dimension tables, handle incremental loads and change tracking, and deploy your work through established CI/CD pipelines. You'll also work closely with business stakeholders, with plenty of scope to grow into platform design over time. Location: London, three days per week in the office Salary: £55,000 – £65,000 + 10% Bonus + Benefits Requirements

• 3+ years of experience as a Data Engineer, building and maintaining production data pipelines within Azure Databricks and ADF.
• Strong Python and PySpark skills, writing clean, testable code.
• Advanced SQL, including query optimisation, plus practical dimensional modelling experience.
• Excellent communication skills, both written and verbal. This is a high-impact role on a modern, cloud-native platform that's small enough to move fast and important enough that what you build gets used. If you're ready to take ownership of pipelines that directly drive pricing and AI-led decision-making, please apply via the link below.