Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Over the last three years Southampton University in the UK has been doing a complete website redesign following an Agile process; user research and performance analytics have been an integral part of the Agile process from the very start. The website has a variety of products aimed at potential students and research collaborators. Performance analytics informed the business case and objectives and qualitative research in Discovery uncovered the user needs to improve the user experience. During alpha qualitative research informed the design of the early prototypes and in beta analytics and user research integrated qual and quant in a variety of metrics around performance and the user experience. The same metrics have been taken forward and enhanced in Live to ensure continuous improvement which sits alongside the new product roadmap. The presentation will outline the integration of qual and quant and give examples of what has been done, the metrics, and how they are informing the user experience and business objectives.
Key Insights
-
•
The previous website had over 4 million URLs with inconsistent content quality leading to high bounce rates—85% left after one page.
-
•
Replacing 1000+ diverse content authors with a smaller specialized team improved content reliability and maintainability.
-
•
Integrating quantitative analytics (GA4, funnels) with qualitative research (heat maps, recordings) allowed a holistic view of user behavior.
-
•
Mapping 30 detailed user journeys and directly linking them to analytics funnels was key to tracking user progress and success.
-
•
Beta testing with 4,000+ volunteer users enabled large-scale testing and informed decisions before full launch.
-
•
Applying a regression formula to derive System Usability Scale scores from just two questions simplified usability benchmarking.
-
•
Heat maps revealed 'click rage' where users mistakenly believed non-clickable elements were interactive, highlighting UX issues not visible in pure analytics.
-
•
Combining research insights with analytics enabled proactive monitoring and continuous improvement rather than reactive fixes.
-
•
Stakeholder engagement, especially involving them in observing user sessions, is crucial to overcome resistance and build trust in data-driven design.
-
•
The project balanced commercial pressures with academic complexity by framing success through clear KPIs focused on user needs and business goals.
Notable Quotes
"We are not collecting vanity analytics here, this data is doing real work informing design decisions."
"Some people prefer their beliefs to data even in academia, which may surprise you."
"The website redesign is much more than a redesign; it’s a complete change in content and design strategy."
"85% of people were leaving after just looking at one page on the old site—that was a huge problem."
"Over 4,000 users volunteered to look at the beta version, giving us excellent data at scale."
"Heat maps don’t just show where people click; they show where people think something is clickable but it isn’t, which causes frustration."
"We use a magic R studio button that, with one click, processes all the survey data automatically."
"Stakeholders often have strong opinions; our job is to back decisions with solid, evidence-based data."
"The System Usability Scale is a powerful benchmarking tool, and reducing it to two questions makes it easier to collect."
"Bringing stakeholders to observe user sessions helps them see that user-centered design isn’t just a cult."
Or choose a question:
More Videos
"The blueprint is really within all of us — all the things that have brought us to this moment should come to our teams."
Jennifer KanyamibwaCreating the Blueprint: Growing and Building Design Teams
November 8, 2018
"If you put more in than you take out of a repository, that’s a good rule of thumb."
Brigette Metzler Dana ChrisfieldResearch Repositories: A global project by the ResearchOps Community (Videoconference)
August 27, 2020
"Project delays are frequently due to organizational and cultural issues rather than actions of the project team."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"We come in like water—hanging out, listening, figuring out where the blood flow is in the environment."
John Mortimer Milan Guenther Lucy Ellis Patrick QuattlebaumPanel Discussion
December 3, 2024
"Gallup says only twelve percent strongly agree their onboarding is great; that’s an abysmal metric."
Dante GuintuHow to Crush the Talent Crunch
September 8, 2022
"We tend to confuse the experience of people with user experience, and I’m less interested in user experience than in the experience of people."
Richard BuchananCreativity and Principles in the Flourishing Enterprise
June 15, 2018
"Normally the theme leader would be talking about sleep deprivation because we’re overstimulated and excited by the talks."
Dan WillisTheme 3: Intro
January 8, 2024
"We don’t celebrate failure; we celebrate the attempt and risk-taking."
Dan WardFailure Friday #1 with Dan Ward
February 7, 2025
"Generative workshops such as design sprints can devolve into political theater if we’re not careful."
Chris GeisonTheme Two Intro
March 28, 2023