Digital Experimentation Manager
Aquent
Recruitment Agency
About the job
Freelance - Digital Experimentation Manager Client Location: London (Remote) Starting: 01/10/2026 Pay Comments: £380 per day Hours: Full-time Duration: 3 months with potential to extend : Manager, Digital Experimentation Reporting to: Senior Manager, Digital Experience & Optimization ABOUT THE ROLE:
- You are a results-driven digital marketer with a proven track record for optimizing web-based user experiences through comprehensive testing and data-driven methodologies and conveying impact and findings to key business stakeholders.
- Your experience and expertise in A/B testing platforms, conversion rate optimization, user feedback programs, and heatmapping analytics for web will shape
- Testing strategy and drive continuous performance improvements.
- In this role on the Digital Experience team, you'll partner with web development, and cross-functional stakeholders to design, execute, and analyze testing programs that deliver measurable business impact as part of the larger Performance Marketing team.
- You'll own the testing platform strategy, establish best practices, and translate complex, multi-platform performance data into actionable insights.
- By staying at the forefront of CRO, experimentation, and user research methodologies, you'll ensure Amex GBT leverages best-in-class testing to remain competitive in an increasingly data-driven digital landscape. WHAT YOU WILL DO:
- A/B Testing Platform & Strategy
- Own the A/B testing platform (Adobe Target) technical set-up, configuration, and documentation library establish and maintain platform governance and access controls.
- Design testing experiment hypotheses in collaboration with team members and stakeholders to leverage site analytics, user behavior data, and user feedback to identify high-impact opportunities.
- Execute and monitor A/B and multi-variant tests to ensure rigorous methodology (Bayesian, Multi-Armed Bandits, etc), consistent data flow, and clear understanding of success metrics.
- Report on A/B testing performance (velocity, lift, statistical significance, business impact) and communicate findings to stakeholders at appropriate levels of details
- Collaborate with technical teams and developers to set up in-depth tracking mechanisms for tests to understand the full context of user experience and isolate variables affecting performance.
- Establish cadence and governance for test documentation, version control, and post-test archival to create institutional knowledge and prevent hypothesis duplication.
- Monitor test configuration and data integrity/validity to ensure reliable experiment results prior to informing business decisions. User Feedback & Testing Programs
- Own and manage the user feedback and research testing platform(s) (Lyssna, UserTesting, etc.) to gather qualitative insights on user behaviors, motivations, and pain points.
- Design and execute user research studies and feedback programs that inform hypothesis generation, validate testing assumptions, and identify new optimization opportunities.
- Synthesize user feedback with quantitative testing data to triangulate findings and prioritize tests with the highest potential impact.
- Establish a net-new feedback program roadmap aligned with business priorities and testing program velocity.
- Maintain and improve user research documentation and insights library for reference across optimization initiatives. UX Data & User Behavior Analysis
- Co-own the heatmapping and session recording platform (HotJar, Quantum Metric, Amplitude) to ensure consistent data flow that aligns with GA and other site data sources
- Map user journeys for live sites and test experiences to develop a comprehensive understanding of user pathways, pain points, and opportunities in partnership with Sr Digital Marketing Performance Manager.
- Synthesize heatmap, session recording, and behavioral data into clear narratives for stakeholder presentations; translate findings into testable hypotheses. Analytics Integration & Data Quality
- Collaborate with the Sr Digital Performance Marketing Manager team to establish seamless data flow from testing platform to GA4, data warehouse, and reporting systems.
- Optimize in-depth tracking and event taxonomy for A/B tests in partnership with Sr Digital Performance
- Marketing Manager and/or agency partners to ensure test data is captured, attributed, and reportable across all downstream analytics platforms.
- Troubleshoot testing-related analytics discrepancies and data integrity issues in partnership with
- Marketing Operations, Development Teams, Web Teams, and other relevant stakeholders. Stakeholder Communication & Support
- Communicate testing program progress, results, and learnings to stakeholders across the organization in clear, accessible formats on a consistent cadence
- Support the Senior Manager, Digital Experience & Optimization with testing portfolio analysis, testing opportunity validation, and prioritization recommendations.
- Partner with cross-functional teams (development, content, product) to ensure testing requirements are clearly understood and implemented correctly. What you have…
- 3+ years of direct experience in A/B testing and conversion rate optimization (CRO)
- Hands-on expertise with Adobe Target and demonstrated ability to manage platform technical set-up, configuration, and documentation.
- Advanced knowledge of UX data tools including heatmaps, session recording, and journey mapping platforms (HotJar, Quantum Metric, Amplitude, or similar).
- Demonstrated experience with user feedback and testing platforms (Lyssna, UserTesting, Maze, or similar) and ability to design and manage user research programs.
- Strong quantitative analytical skills with the ability to design sound hypotheses, interpret statistical significance, and communicate performance metrics.
- JS/jQuery or CSS familiarity for advanced testing processes
- User-centric mindset with a deep understanding of B2B user behavior and decision-making pathways across the entire user lifecycle.
- Demonstrated proficiency with Google Analytics (GA4), Google Tag Manager, and web analytics best practices; ability to coordinate tracking with development teams.
- Excellent written and verbal communication skills with the ability to translate complex data into clear insights for technical and non-technical audiences.
- Stellar attention to detail and commitment to data quality; an organized approach to documentation, testing governance, and stakeholder management.
- Experience working collaboratively with global teams in different time zones across development, marketing, and product teams to prioritize and execute testing programs aligned with business objectives. Even better…
- Familiarity with personalization, segmentation, and advanced targeting capabilities.
- Certifications in Google Analytics, CRO, experimentation methodologies, or related fields.
- Experience with statistical analysis, sample size calculation, and multi-variant testing methodologies.
- Experienced with agile methodologies and comfortable in rapidly evolving, cross-functional team environments.
- Proven experience building and scaling testing programs from early stage to mature, high-velocity operations.
- Understanding compliance and ethical standards in digital marketing and user research (GDPR, CCPA, informed consent, etc.).
- Passion for continuous learning and staying current with CRO, experimentation, and user research industry trends, including emerging personalization and segmentation capabilities.
- Multilingual is a plus!
Sign up for free or
Log in to view all job posting insights and get access to competitive insights.
Job ref blurredText
Posted on blurredText
Last checked on blurredText
Closing on blurredText
0 comments
0 requirements
Discuss this job
Share your intel on this vacancy and help others - anonymously. Get notified automatically of new comments when starred or saved to Tracker.
Log in to view and post comments.
My Private Notes
Saving private notes will automatically star the vacancy to your Jobs page.
Log in to view and save your private notes.