Summary
In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!
Key Insights
-
•
ISQUER uses a patented technology combining explicit UX ratings, NPS, and implicit reaction time measures to deliver comprehensive user experience benchmarking.
-
•
Implicit measurements like reaction time explain about 40% of purchase decisions, highlighting the power of capturing gut feelings in UX evaluation.
-
•
UX online benchmarking evaluates both users and non-users to uncover differences in perception and loyalty towards products or sites.
-
•
Participants explore the full live website or app freely for around three minutes, not just the homepage, allowing holistic experience assessment.
-
•
Home24 scores highest on appeal and inspiration, demonstrating that clean, well-structured sites generate stronger positive intuitive reactions.
-
•
Amazon receives higher NPS scores on mobile than desktop, indicating platform-specific performance differences in UX.
-
•
Ebay consistently scores low across many UX dimensions, especially among non-users, reflecting challenges in brand perception and usability.
-
•
Benchmarking enables product teams to quantitatively track the impact of changes by repeating studies post-optimization or relaunch.
-
•
About half of the UX decisions can be attributed to unconscious user processes, making implicit testing essential.
-
•
ISQUER’s long history since 1999 and their extensive global database support the reliability and actionability of their benchmarking results.
Notable Quotes
"UX online benchmarking offers a fast and efficient way to identify strengths and weaknesses compared to competitors."
"We combine explicit and implicit quantitative methods to fully get the user's perspective on the tested products."
"The first impression triggers unconscious processes that heavily influence purchase decisions."
"The Product React uses reaction time to capture the user’s gut feeling that otherwise remains hidden."
"Users typically rate a product better than non-users because of familiarity and built-up trust."
"Amazon performs better on mobile than on desktop according to our Net Promoter Score measurements."
"Home 24’s site feels more appealing and inspiring because it’s well structured and not overwhelming."
"The method is not just about the homepage but the whole experience the participant explores freely within minutes."
"We have been applying implicit reaction testing since 1999, which distinguishes us from many others."
"Benchmarking can be used repeatedly to track whether optimizations have the desired effect over time."
Dig deeper—ask the Rosenbot:
More Videos
"Researchers submit questions that get combined into one survey, translated, then responses are translated back for analysis."
Wyatt HaymanGlobal Research Panels (Videoconference)
August 8, 2020
"Our UI kits are generated through JavaScript from design tokens, reducing manual errors and keeping everything up to date."
PJ Buddhari Nate BaldwinMeet Spectrum, Adobe’s Design System
June 9, 2021
"Evan spent less than 15 minutes on his essay because he used AI to write it for him."
Sarah GallimoreInspire Progress with Artifacts from the Future
November 18, 2022
"UX directors often feel like this poor person in the middle here getting pulled in all these directions."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"We need to be radically honest about who was in the research rather than blindly trusting generalized findings."
Dr. Jamika D. Burge Mansi GuptaAdvancing the Inclusion of Womxn in Research Practices (Videoconference)
September 15, 2022
"I never want to walk into a review with my stakeholders and see something for the first time."
Amy MarquezINVEST: Discussion
June 15, 2018
"Valorant builds hyperlocal agents with teams from the agent’s actual city to boost authenticity and representation."
Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl PlatzBeyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)
May 17, 2024
"If you are silent about your pain, they will kill you and say you enjoyed it."
Zariah CameronReDesigning Wellbeing for Equitable Care in the Workplace
September 23, 2024
"ADHD isn’t a deficit of attention, but trouble regulating it, which leads to hyperfocus on interesting tasks."
Jessica NorrisADHD: A DesignOps Superpower
September 9, 2022
