Summary
In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!
Key Insights
-
•
ISQUER uses a patented technology combining explicit UX ratings, NPS, and implicit reaction time measures to deliver comprehensive user experience benchmarking.
-
•
Implicit measurements like reaction time explain about 40% of purchase decisions, highlighting the power of capturing gut feelings in UX evaluation.
-
•
UX online benchmarking evaluates both users and non-users to uncover differences in perception and loyalty towards products or sites.
-
•
Participants explore the full live website or app freely for around three minutes, not just the homepage, allowing holistic experience assessment.
-
•
Home24 scores highest on appeal and inspiration, demonstrating that clean, well-structured sites generate stronger positive intuitive reactions.
-
•
Amazon receives higher NPS scores on mobile than desktop, indicating platform-specific performance differences in UX.
-
•
Ebay consistently scores low across many UX dimensions, especially among non-users, reflecting challenges in brand perception and usability.
-
•
Benchmarking enables product teams to quantitatively track the impact of changes by repeating studies post-optimization or relaunch.
-
•
About half of the UX decisions can be attributed to unconscious user processes, making implicit testing essential.
-
•
ISQUER’s long history since 1999 and their extensive global database support the reliability and actionability of their benchmarking results.
Notable Quotes
"UX online benchmarking offers a fast and efficient way to identify strengths and weaknesses compared to competitors."
"We combine explicit and implicit quantitative methods to fully get the user's perspective on the tested products."
"The first impression triggers unconscious processes that heavily influence purchase decisions."
"The Product React uses reaction time to capture the user’s gut feeling that otherwise remains hidden."
"Users typically rate a product better than non-users because of familiarity and built-up trust."
"Amazon performs better on mobile than on desktop according to our Net Promoter Score measurements."
"Home 24’s site feels more appealing and inspiring because it’s well structured and not overwhelming."
"The method is not just about the homepage but the whole experience the participant explores freely within minutes."
"We have been applying implicit reaction testing since 1999, which distinguishes us from many others."
"Benchmarking can be used repeatedly to track whether optimizations have the desired effect over time."
Or choose a question:
More Videos
"Policies must evolve to reflect the urgency of our situation."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"Mentors are wonderful partners for feedback, collaboration, and setting employees up for success."
Laine Riley Prokay Lisa GordonCarving a Path for Early Career DesignOps Practitioners
September 9, 2022
"We stopped talking about patterns and consistency and started talking about scalability and speed to connect with stakeholders."
Eniola OluwoleLessons From the DesignOps Journey of the World's Largest Travel Site
October 24, 2019
"Traditional MBAs are confident about many things that aren’t true, and your research will often challenge their worldview."
Nathan ShedroffDouble Your Mileage: Use Your Research Strategically
March 31, 2020
"On mobile, the version of the screen reader matches the OS version, making it easier to test and replicate issues."
Sam ProulxMobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
November 17, 2022
"Rapid research is a flexible framework for quickly executing UX research for fast and often tactical or evaluative design decisions."
Feleesha SterlingBuilding a Rapid Research Program (Videoconference)
May 18, 2023
"Brand and product become two sides of the same coin when user insights have a seat at the top table."
Neil BarrieWidening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
March 25, 2024
"We move here. We never actually become New Yorkers."
John DevanneyThe Design Management Office
November 6, 2017
"We decided to jump off the wall — it was scary but the opportunity was too big to pass up."
Katy MogalBut Do Your Insights Scale?
March 12, 2021