Data Engineer
at WiraaAbout The Company Two Circles is a leading Sports & Entertainment Marketing business dedicated to growing audiences and revenues for its clients worldwide. With a deep understanding of fan behavior and preferences, we help brands and organizations influence and engage their audiences across various touchpoints. Our expertise spans understanding how fans spend their money, attend events, respond to different channels, and consume content. Trusted by over 1000 clients globally, including prestigious organizations such as the English Premier League, Red Bull, UEFA, VISA, the NFL, Nike, and Amazon, we pride ourselves on delivering innovative solutions that drive growth. Our team comprises over 1000 professionals operating from 15 offices around the world, working with sports and entertainment businesses of all sizes to create meaningful fan experiences and measurable business outcomes. About The Role We are seeking a talented Data Engineer with strong, hands-on expertise in Databricks to join our dynamic team working on the Fan Intelligence Platform. This role offers an exciting opportunity to be at the forefront of data platform development, focusing on Databricks as a core technology. As part of a team of over 50 Data & BI Engineers, you will contribute to building scalable, efficient data pipelines, optimize existing data workflows, and help shape the future direction of our data platform. The ideal candidate will be passionate about data engineering, eager to learn new technologies, and comfortable working in a fast-paced, collaborative environment. You will have the chance to work on innovative projects that leverage AI-assisted development and modern data architecture, impacting how fans are understood and engaged across the sports industry. Qualifications
- Strong, hands-on production experience with Databricks, including Delta Lake, Unity Catalog, PySpark/Spark SQL, and performance tuning
- Proficiency in object-oriented Python, with a solid foundation in class design, best practices, and writing testable, maintainable code
- Aptitude for AI-assisted development tools and methodologies
- Strong SQL skills for querying and managing data
- Experience working within a data lakehouse environment
- Knowledge of Azure services such as Azure Data Factory (ADF) and Function Apps
- Experience with CI/CD pipelines, preferably using Azure DevOps or similar tools
- Desirable: Databricks Certified Data Engineer Professional or working towards certification
- Ability to learn quickly, adapt to new technologies, and collaborate effectively within a team
- Excellent problem-solving skills and attention to detail
- Comfortable working in an Agile environment, estimating and delivering incremental value Responsibilities
- Design, build, and optimize scalable data pipelines on Databricks, utilizing Delta Lake, Unity Catalog, and Spark/PySpark
- Develop clean, maintainable, and testable Python code adhering to engineering best practices
- Participate actively in Agile ceremonies, including sprint planning, stand-ups, and retrospectives
- Collaborate closely with product and marketing teams to deliver data-driven insights and solutions that create high business value
- Extend expertise into the wider Azure data platform, including ADF and Function Apps, as well as CI/CD practices
- Contribute to the continuous improvement and modernization of the Databricks platform, aiming to enhance efficiency and capabilities
- Stay current with emerging technologies and incorporate innovative approaches into the data engineering processes Benefits
- Summer away days to promote work-life balance
- 23 standard days of holiday, plus additional days for special occasions and company-wide closures
- Discretionary bonus based on company performance
- Performance reviews every six months with potential salary increases
- Private Healthcare scheme (Vitality) or Medicash
- Mobile phone contribution
- Sport challenge contribution
- Gym membership contribution
- Annual kit drops to support your work and comfort Equal Opportunity
Job ref blurredText
Posted on blurredText
Last checked on blurredText
Closing on blurredText
Discuss this job
Share your intel on this vacancy and help others - anonymously. Get notified automatically of new comments when starred or saved to Tracker.
pretend that this is a blurredText long comment
My Private Notes
Saving private notes will automatically star the vacancy to your Jobs page.