Lead Data Architect

We are recruiting on behalf of our client, a growing Salesforce, Data and AI consultancy, who are looking for a Databricks Lead Architect to take ownership of their Databricks practice and help shape its technical direction as the business continues to grow. This is a fantastic opportunity for a hands-on Databricks expert to become the first dedicated hire in this area, combining architecture, technical delivery, client engagement and pre-sales. You'll have the freedom to make key technical decisions, establish best practices and build a scalable Databricks capability within a commercially successful consultancy with a genuine commitment to AI innovation. Our client is delivering complex data transformation programmes, helping organisations modernise legacy infrastructure, migrate large volumes of data to the cloud, improve data governance and unlock the value of connected data. You'll work with cutting-edge technologies, alongside highly skilled technical teams, with the opportunity to influence both client solutions and the future of the Databricks practice. The Role As Databricks Lead Architect, you'll own the end-to-end technical solution across client engagements, from discovery and architecture through to hands-on implementation, production release and handover. Initially, you'll remain closely involved in the technical build, before gradually shifting towards solution leadership, coaching and practice development as the team grows. You'll also play a key role in pre-sales, helping clients understand the value of Databricks, shaping technical solutions and supporting the development of new business opportunities. Key Responsibilities

• Own the end-to-end architecture and delivery of Databricks solutions, from discovery through to production.
• Design and document high-level and low-level architectures, data models, system landscapes, security and governance frameworks.
• Lead technical decisions covering Lakehouse architecture, Unity Catalog, Delta Lake, compute strategy, ingestion patterns and medallion architecture.
• Remain hands-on with implementation, building pipelines, notebooks, workflows, jobs and migration solutions.
• Work with Python, Apache Spark and SQL, using Git-based development and CI/CD practices.
• Lead the migration of large-scale data from on-premises and legacy platforms into the cloud.
• Design robust data governance, access controls, lineage and data-sharing solutions.
• Optimise performance, scalability and costs across complex data environments.
• Lead technical workshops and manage stakeholders, from engineering teams through to senior leadership and C-level executives.
• Develop reusable intellectual property, including reference architectures, templates, migration patterns and delivery playbooks.
• Coach and develop existing data and integration consultants, as well as more junior engineering and QA teams.
• Support pre-sales activities, including technical discovery, solution design, scoping, effort estimation, proof of concepts and demonstrations.
• Explore emerging Databricks capabilities, including Mosaic AI, vector search and GenAI workloads.
• Support integrations with wider enterprise platforms, including Salesforce Data 360 and integration technologies such as MuleSoft or Informatica.
• Help establish the technical standards, delivery practices and expertise required to scale the Databricks practice. Skills and Experience Required
• Proven experience as a Lead Architect or Solution Architect on Databricks implementations, covering discovery, design, development, production release and support.
• Deep hands-on expertise across the Databricks platform, including Unity Catalog, Delta Lake, workflows and jobs, declarative pipelines, SQL warehouses and compute configuration.
• Experience migrating substantial volumes of data from on-premises or legacy platforms, such as SQL Server, Teradata or file-based environments.
• Strong Python, Apache Spark and SQL skills.
• Experience designing layered data architectures, including medallion architecture, and explaining the associated technical trade-offs.
• Strong knowledge of data governance, security, access management, lineage and data classification.
• Experience with at least one major cloud platform, ideally Azure, including networking, identity, storage and private connectivity.
• Ability to produce high-quality architecture documentation, including HLDs, LLDs, ERDs, data models and security designs.
• Experience with Git, CI/CD and modern development practices for Databricks solutions.
• Strong understanding of cost modelling, compute optimisation, performance and scalability.
• Excellent client-facing skills, with the ability to lead technical workshops, manage senior stakeholders and communicate complex concepts clearly.
• Experience coaching engineers, reviewing technical solutions and establishing delivery best practices.
• Comfortable supporting pre-sales activities and translating business challenges into practical technical solutions.
• Working knowledge of Mosaic AI, vector search and the use of Databricks for machine learning and generative AI workloads.
• Databricks Certified Data Engineer Professional certification, or working towards it. Experience integrating Databricks with Salesforce Data 360, MuleSoft, Informatica or other enterprise platforms would be advantageous. Nice to Have
• Experience working for a Databricks systems integration partner or directly for Databricks.
• Familiarity with competing or complementary technologies such as Snowflake, Microsoft Fabric, Azure Synapse and dbt.
• Existing relationships within the Databricks ecosystem.
• Experience establishing a new technical capability or building a team from the ground up. What's on Offer
• Competitive salary.
• The opportunity to become the first dedicated Databricks hire and shape the direction of the practice.
• A genuine balance of hands-on technical delivery, architecture, leadership and pre-sales.
• The freedom to influence technical standards, delivery approaches and reusable solutions.
• Exposure to complex, large-scale data transformation and AI programmes.
• The opportunity to work with cutting-edge technology within a consultancy that actively invests in AI innovation.
• Private Medical Insurance.
• Life Assurance.
• Dental, optical, physiotherapy and other healthcare cashback schemes.
• Salary sacrifice pension.
• 28 days annual leave.
• Hybrid working, with regular office days arranged around your needs.
• £250 working-from-home allowance.
• Perks and discounts through dedicated apps.
• Dog-friendly office and regular team events. Apply Now If you are interested in this opportunity, please email your CV marketing@resourceondemand.com, confirming your availability and eligibility to work in the UK.