Summary
In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!
Key Insights
-
•
ISQUER uses a patented technology combining explicit UX ratings, NPS, and implicit reaction time measures to deliver comprehensive user experience benchmarking.
-
•
Implicit measurements like reaction time explain about 40% of purchase decisions, highlighting the power of capturing gut feelings in UX evaluation.
-
•
UX online benchmarking evaluates both users and non-users to uncover differences in perception and loyalty towards products or sites.
-
•
Participants explore the full live website or app freely for around three minutes, not just the homepage, allowing holistic experience assessment.
-
•
Home24 scores highest on appeal and inspiration, demonstrating that clean, well-structured sites generate stronger positive intuitive reactions.
-
•
Amazon receives higher NPS scores on mobile than desktop, indicating platform-specific performance differences in UX.
-
•
Ebay consistently scores low across many UX dimensions, especially among non-users, reflecting challenges in brand perception and usability.
-
•
Benchmarking enables product teams to quantitatively track the impact of changes by repeating studies post-optimization or relaunch.
-
•
About half of the UX decisions can be attributed to unconscious user processes, making implicit testing essential.
-
•
ISQUER’s long history since 1999 and their extensive global database support the reliability and actionability of their benchmarking results.
Notable Quotes
"UX online benchmarking offers a fast and efficient way to identify strengths and weaknesses compared to competitors."
"We combine explicit and implicit quantitative methods to fully get the user's perspective on the tested products."
"The first impression triggers unconscious processes that heavily influence purchase decisions."
"The Product React uses reaction time to capture the user’s gut feeling that otherwise remains hidden."
"Users typically rate a product better than non-users because of familiarity and built-up trust."
"Amazon performs better on mobile than on desktop according to our Net Promoter Score measurements."
"Home 24’s site feels more appealing and inspiring because it’s well structured and not overwhelming."
"The method is not just about the homepage but the whole experience the participant explores freely within minutes."
"We have been applying implicit reaction testing since 1999, which distinguishes us from many others."
"Benchmarking can be used repeatedly to track whether optimizations have the desired effect over time."
Or choose a question:
More Videos
"Users’ perception predicts attrition and paid referrals — design absolutely matters when people decide to buy or go."
Standardizing Product Merits for Leaders, Designers, and Everyone
June 15, 2018
"The Red Queen effect means if others adapt, you must adapt or lose."
Simon WardleyMaps and Topographical Intelligence (Videoconference)
January 31, 2019
"Bias is a tendency, feeling or opinion for or against something without reason or evidence."
Sandra CamachoCreating More Bias-Proof Designs
January 22, 2025
"It takes at least one team member to choose to set healthy standards for collaboration."
Darian DavisLessons from a Toxic Work Relationship
January 8, 2024
"After each interview, I input the transcript into ChatGPT and ask for three key takeaways that I can quickly share with stakeholders."
Fisayo Osilaja[Demo] The AI edge: From researcher to strategist
June 4, 2024
"Temporary, quick, and sometimes rough artifacts have a lifespan just long enough for the conversation they enable."
Uday GajendarThe Wicked Craft of Enterprise UX
May 13, 2015
"Investing in people and fostering collaboration always pays off in stronger teams and better user experiences."
Davis Neable Guy SegalHow to Drive a Design Project When you Don’t Have a Design Team
June 10, 2021
"Everyone wanted to know what was the official pattern and who was accountable for it."
Eniola OluwoleLessons From the DesignOps Journey of the World's Largest Travel Site
October 24, 2019
"Design producers love their creative tools and want to keep using them without multiple manual reporting steps."
Aurobinda Pradhan Shashank DeshpandeIntroduction to Collaborative DesignOps using Cubyts
September 9, 2022
