Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Over the last three years Southampton University in the UK has been doing a complete website redesign following an Agile process; user research and performance analytics have been an integral part of the Agile process from the very start. The website has a variety of products aimed at potential students and research collaborators. Performance analytics informed the business case and objectives and qualitative research in Discovery uncovered the user needs to improve the user experience. During alpha qualitative research informed the design of the early prototypes and in beta analytics and user research integrated qual and quant in a variety of metrics around performance and the user experience. The same metrics have been taken forward and enhanced in Live to ensure continuous improvement which sits alongside the new product roadmap. The presentation will outline the integration of qual and quant and give examples of what has been done, the metrics, and how they are informing the user experience and business objectives.
Key Insights
-
•
The previous website had over 4 million URLs with inconsistent content quality leading to high bounce rates—85% left after one page.
-
•
Replacing 1000+ diverse content authors with a smaller specialized team improved content reliability and maintainability.
-
•
Integrating quantitative analytics (GA4, funnels) with qualitative research (heat maps, recordings) allowed a holistic view of user behavior.
-
•
Mapping 30 detailed user journeys and directly linking them to analytics funnels was key to tracking user progress and success.
-
•
Beta testing with 4,000+ volunteer users enabled large-scale testing and informed decisions before full launch.
-
•
Applying a regression formula to derive System Usability Scale scores from just two questions simplified usability benchmarking.
-
•
Heat maps revealed 'click rage' where users mistakenly believed non-clickable elements were interactive, highlighting UX issues not visible in pure analytics.
-
•
Combining research insights with analytics enabled proactive monitoring and continuous improvement rather than reactive fixes.
-
•
Stakeholder engagement, especially involving them in observing user sessions, is crucial to overcome resistance and build trust in data-driven design.
-
•
The project balanced commercial pressures with academic complexity by framing success through clear KPIs focused on user needs and business goals.
Notable Quotes
"We are not collecting vanity analytics here, this data is doing real work informing design decisions."
"Some people prefer their beliefs to data even in academia, which may surprise you."
"The website redesign is much more than a redesign; it’s a complete change in content and design strategy."
"85% of people were leaving after just looking at one page on the old site—that was a huge problem."
"Over 4,000 users volunteered to look at the beta version, giving us excellent data at scale."
"Heat maps don’t just show where people click; they show where people think something is clickable but it isn’t, which causes frustration."
"We use a magic R studio button that, with one click, processes all the survey data automatically."
"Stakeholders often have strong opinions; our job is to back decisions with solid, evidence-based data."
"The System Usability Scale is a powerful benchmarking tool, and reducing it to two questions makes it easier to collect."
"Bringing stakeholders to observe user sessions helps them see that user-centered design isn’t just a cult."
Dig deeper—ask the Rosenbot:
More Videos
"Users typically rate a product better than non-users because of familiarity and built-up trust."
Daniela Magaña Flores Ariane Rahn Jeff Ephraim BanderAhead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
March 10, 2022
"Prompting at its core involves very specifically using the inputs you give the technology so you can elicit desired outputs."
Savina HawkinsHarnessing AI in UXR: Practical Strategies for Positive Impact
March 26, 2024
"Each species lost is a thread untethered from the web of life that supports us all."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"We’re indexing individual concepts or insights to help find connections instantly rather than relying on whole reports."
Matt DuignanHITS, Microsoft's internal human insight system: From research library to living body of knowledge (Videoconference)
July 16, 2019
"The only form of ethical persuasion that exists is when the goals of the persuader are aligned with the goals of the persuading - Tristan Harris."
Craig VillamorDesign Systems for Ethical Design (Videoconference)
January 26, 2023
"My job is to convince people to create something that doesn't exist or hasn't been discovered yet."
Ovetta SampsonTurning UX Passion into Real Product Influence
June 7, 2023
"AI is making data more accessible to everybody, but it’s not going to make things better for us in the near future."
Rima Campbell Amrit S BhachuIncrease Productivity and Drive Business Impact
September 24, 2024
"Leadership trust score went up by 22 points after design ops was established – that’s how we measured impact."
Amy Gawronski ZuccaroAdvice for DesignOps Employee #1
September 29, 2021
"Whiteness isn’t just the color or race; people of all colors can reinforce white supremacy."
Victor UdoewaBeyond Methods and Diversity: The Roots of Inclusion
March 26, 2024
