Senior Data Engineer - Databricks

Senior Data Engineer – Databricks | Competitive Salary | UK (Remote) Are you an experienced Data Engineer who enjoys turning complex data into reliable, scalable solutions? Do you have strong hands-on experience with Databricks, PySpark, Python and SQL? The role 7Dxperts is looking for a Senior Data Engineer – Databricks to join our UK team. You'll build and improve data pipelines that solve real business problems, working with modern Databricks and cloud technologies. Alongside hands-on development, you'll troubleshoot issues, improve performance and work closely with engineers, analysts, data scientists and technical leads. Key Responsibilities You will:

• Build scalable pipelines using Databricks, Spark and PySpark.
• Develop ETL/ELT and data transformation workflows using Python and SQL.
• Create and maintain Databricks notebooks, jobs, workflows and clusters.
• Work with Delta Lake and lakehouse architectures.
• Monitor, troubleshoot and optimise pipeline performance.
• Maintain high standards of data quality and reliability.
• Work across AWS, Azure or GCP environments.
• Automate processes and create reusable engineering solutions.
• Support and mentor junior Data Engineers. The person We're looking for:
• 5+ years' Data Engineering experience.
• Strong hands-on Databricks, PySpark, Python and SQL skills.
• Experience building and optimising ETL/ELT data pipelines.
• Knowledge of Delta Lake and data warehousing.
• Experience with at least one of AWS, Azure or GCP.
• Strong troubleshooting and problem-solving skills.
• A Computer Science or related technical background.
• Experience with Unity Catalog, MLflow, CI/CD, Terraform or Databricks certification would be a bonus. About 7Dxperts 7Dxperts helps organisations solve complex challenges using Data, Spatial and Machine Learning technologies. We focus on building practical, targeted solutions that make a measurable difference. What we offer
• Databricks training and upskilling.
• Support towards technical certifications.
• Exposure to AWS, Azure and GCP.
• Varied data engineering projects.
• Technical and leadership development.
• Sponsorship may be available depending on circumstances. What's next?