Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Over the last three years Southampton University in the UK has been doing a complete website redesign following an Agile process; user research and performance analytics have been an integral part of the Agile process from the very start. The website has a variety of products aimed at potential students and research collaborators. Performance analytics informed the business case and objectives and qualitative research in Discovery uncovered the user needs to improve the user experience. During alpha qualitative research informed the design of the early prototypes and in beta analytics and user research integrated qual and quant in a variety of metrics around performance and the user experience. The same metrics have been taken forward and enhanced in Live to ensure continuous improvement which sits alongside the new product roadmap. The presentation will outline the integration of qual and quant and give examples of what has been done, the metrics, and how they are informing the user experience and business objectives.
Key Insights
-
•
The previous website had over 4 million URLs with inconsistent content quality leading to high bounce rates—85% left after one page.
-
•
Replacing 1000+ diverse content authors with a smaller specialized team improved content reliability and maintainability.
-
•
Integrating quantitative analytics (GA4, funnels) with qualitative research (heat maps, recordings) allowed a holistic view of user behavior.
-
•
Mapping 30 detailed user journeys and directly linking them to analytics funnels was key to tracking user progress and success.
-
•
Beta testing with 4,000+ volunteer users enabled large-scale testing and informed decisions before full launch.
-
•
Applying a regression formula to derive System Usability Scale scores from just two questions simplified usability benchmarking.
-
•
Heat maps revealed 'click rage' where users mistakenly believed non-clickable elements were interactive, highlighting UX issues not visible in pure analytics.
-
•
Combining research insights with analytics enabled proactive monitoring and continuous improvement rather than reactive fixes.
-
•
Stakeholder engagement, especially involving them in observing user sessions, is crucial to overcome resistance and build trust in data-driven design.
-
•
The project balanced commercial pressures with academic complexity by framing success through clear KPIs focused on user needs and business goals.
Notable Quotes
"We are not collecting vanity analytics here, this data is doing real work informing design decisions."
"Some people prefer their beliefs to data even in academia, which may surprise you."
"The website redesign is much more than a redesign; it’s a complete change in content and design strategy."
"85% of people were leaving after just looking at one page on the old site—that was a huge problem."
"Over 4,000 users volunteered to look at the beta version, giving us excellent data at scale."
"Heat maps don’t just show where people click; they show where people think something is clickable but it isn’t, which causes frustration."
"We use a magic R studio button that, with one click, processes all the survey data automatically."
"Stakeholders often have strong opinions; our job is to back decisions with solid, evidence-based data."
"The System Usability Scale is a powerful benchmarking tool, and reducing it to two questions makes it easier to collect."
"Bringing stakeholders to observe user sessions helps them see that user-centered design isn’t just a cult."
Or choose a question:
More Videos
"It is imperative that we maintain hope, even when the harshness of reality may suggest the opposite. — Paola Freire"
Angelos ArnisNavigating the Rapid Shifts in Tech's Turbulent Terrain
October 2, 2023
"Spreadsheets might just be the best tool for everything in design ops."
John Calhoun Rachel PosmanBring your DesignOps Story to Life! The Definitive DesignOps Book Jam
October 3, 2023
"Usability testing is the gateway drug for research; similarly, small measurements are the gateway for strategic design impact."
Alfred KahnA Seat at the Table: Making Your Team a Strategic Partner
November 29, 2023
"It’s never all or nothing — product success must balance user needs and business constraints."
Dan WillisEnterprise Storytelling Sessions
June 3, 2019
"Design can have an impact on the bottom line, but that puts pressure on design to justify its value economically."
John Maeda Alison RandAbout Design Organizations (Videoconference)
May 13, 2019
"We consolidated over 10 configurable tools into one holistic supply chain management tool this year."
Anat Fintzi Rachel MinnicksDelivering at Scale: Making Traction with Resistant Partners
June 9, 2022
"Creating tangible artifacts forces reaction and debate, helping break enterprise paralysis and drive decisions."
Uday GajendarThe Wicked Craft of Enterprise UX
May 13, 2015
"This is a super exciting time in the brief history of what we’re calling design operations."
Kristin SkinnerTheme 1 Intro
September 29, 2021
"Closing the learning-doing gap means moving from making content just to publish, to making content that ensures the customer’s job is done."
Maish NichaniSparking a Service Excellence Mindset at a Government Agency
December 9, 2021
