Summary
In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!
Key Insights
-
•
ISQUER uses a patented technology combining explicit UX ratings, NPS, and implicit reaction time measures to deliver comprehensive user experience benchmarking.
-
•
Implicit measurements like reaction time explain about 40% of purchase decisions, highlighting the power of capturing gut feelings in UX evaluation.
-
•
UX online benchmarking evaluates both users and non-users to uncover differences in perception and loyalty towards products or sites.
-
•
Participants explore the full live website or app freely for around three minutes, not just the homepage, allowing holistic experience assessment.
-
•
Home24 scores highest on appeal and inspiration, demonstrating that clean, well-structured sites generate stronger positive intuitive reactions.
-
•
Amazon receives higher NPS scores on mobile than desktop, indicating platform-specific performance differences in UX.
-
•
Ebay consistently scores low across many UX dimensions, especially among non-users, reflecting challenges in brand perception and usability.
-
•
Benchmarking enables product teams to quantitatively track the impact of changes by repeating studies post-optimization or relaunch.
-
•
About half of the UX decisions can be attributed to unconscious user processes, making implicit testing essential.
-
•
ISQUER’s long history since 1999 and their extensive global database support the reliability and actionability of their benchmarking results.
Notable Quotes
"UX online benchmarking offers a fast and efficient way to identify strengths and weaknesses compared to competitors."
"We combine explicit and implicit quantitative methods to fully get the user's perspective on the tested products."
"The first impression triggers unconscious processes that heavily influence purchase decisions."
"The Product React uses reaction time to capture the user’s gut feeling that otherwise remains hidden."
"Users typically rate a product better than non-users because of familiarity and built-up trust."
"Amazon performs better on mobile than on desktop according to our Net Promoter Score measurements."
"Home 24’s site feels more appealing and inspiring because it’s well structured and not overwhelming."
"The method is not just about the homepage but the whole experience the participant explores freely within minutes."
"We have been applying implicit reaction testing since 1999, which distinguishes us from many others."
"Benchmarking can be used repeatedly to track whether optimizations have the desired effect over time."
Or choose a question:
More Videos
"Senior designers are subject matter experts, staff designers navigate ambiguity, and principal designers create business impact."
Catt Small Micah Bennett Brian Carr Jessica HarlleeWhat's Next for ICs: Exploring Staff and Principal Designer Roles (Videoconference)
February 22, 2024
"Our UI focused on saving time, making the workflow one button and enabling manual edits and regeneration for error recovery."
Jennifer Kong[Case study] Journeying toward AI-assisted documentation in healthcare
June 5, 2024
"Think critically about what we're sharing, who we're sharing with, and how we share to ensure understanding and action."
Sara LogelYour Colleagues are Your Users Too
March 29, 2023
"We created a rolling study program where researchers owned expertise for specific user roles, resulting in more efficient studies."
Veevi RosensteinBuilding for Scale: Creating the Zendesk UX Research Practice
January 8, 2024
"Our culture means if someone publishes something questionable, there’s a transparent discussion."
Michelle Bejian Lotia Anne-Marie MorellRolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
March 28, 2023
"Labeling someone difficult is dangerous; challenge your feelings, the facts, and your interpretations first."
Tutti TaygerlyVideconference: How to Work with Difficult People with Tutti Taygerly
June 25, 2020
"We transitioned designers embedded on low priority projects to higher priority ones within three weeks."
Patrick CommarfordDesign Staffing for Impact
January 8, 2024
"Balancing strategic vision and tactical execution inspires teams to secure stakeholder buy-in and drive positive change."
Frances YllanaTheme 2 Intro
September 24, 2024
"Engineering organizations like familiar frameworks; speak their language visually as well as verbally."
Mujtaba HameedFrameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research
March 26, 2024
Dig deeper with the Rosenbot
What are practical ways to incorporate participatory design in accessibility research?
How might subscription services be redesigned using thinking styles to better address user financial and emotional concerns?
Why is the relationship between the user and security communications critical to security outcomes?