Summary
In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!
Key Insights
-
•
ISQUER uses a patented technology combining explicit UX ratings, NPS, and implicit reaction time measures to deliver comprehensive user experience benchmarking.
-
•
Implicit measurements like reaction time explain about 40% of purchase decisions, highlighting the power of capturing gut feelings in UX evaluation.
-
•
UX online benchmarking evaluates both users and non-users to uncover differences in perception and loyalty towards products or sites.
-
•
Participants explore the full live website or app freely for around three minutes, not just the homepage, allowing holistic experience assessment.
-
•
Home24 scores highest on appeal and inspiration, demonstrating that clean, well-structured sites generate stronger positive intuitive reactions.
-
•
Amazon receives higher NPS scores on mobile than desktop, indicating platform-specific performance differences in UX.
-
•
Ebay consistently scores low across many UX dimensions, especially among non-users, reflecting challenges in brand perception and usability.
-
•
Benchmarking enables product teams to quantitatively track the impact of changes by repeating studies post-optimization or relaunch.
-
•
About half of the UX decisions can be attributed to unconscious user processes, making implicit testing essential.
-
•
ISQUER’s long history since 1999 and their extensive global database support the reliability and actionability of their benchmarking results.
Notable Quotes
"UX online benchmarking offers a fast and efficient way to identify strengths and weaknesses compared to competitors."
"We combine explicit and implicit quantitative methods to fully get the user's perspective on the tested products."
"The first impression triggers unconscious processes that heavily influence purchase decisions."
"The Product React uses reaction time to capture the user’s gut feeling that otherwise remains hidden."
"Users typically rate a product better than non-users because of familiarity and built-up trust."
"Amazon performs better on mobile than on desktop according to our Net Promoter Score measurements."
"Home 24’s site feels more appealing and inspiring because it’s well structured and not overwhelming."
"The method is not just about the homepage but the whole experience the participant explores freely within minutes."
"We have been applying implicit reaction testing since 1999, which distinguishes us from many others."
"Benchmarking can be used repeatedly to track whether optimizations have the desired effect over time."
Or choose a question:
More Videos
"Story points should apply to UX work as well as development, helping make UX time and effort visible and planned for."
Jack MoffettSAFe or Sorry? (Videoconference)
May 29, 2019
"If organizations want success globally, they must invest to customize designs for local cultures rather than standardize everything blindly."
Tricia WangSCALE: Discussion
June 15, 2018
"Once automation is running, support staff get cut and users have to manage more complex systems themselves."
Fredrik MathesonFirst-time users, longtime strategies: Why Parkinson’s Law is making you less effective at work – and how to design a fix.
June 8, 2016
"Our career competencies are not a checklist or promotion; it's not an expectation that directs get excelling scores across their level to advance."
Laine Riley ProkayHow DesignOps can Drive Inclusive Career Ladders for All
September 30, 2021
"VOC enhances but does not replace user research; it captures the nuggets that would otherwise get lost."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"Slowing down with research can help us move faster overall."
Kristen Guth, Ph.D.Out of the FOG: A Non-traditional Research Approach to Alignment
March 28, 2023
"Diversity sitting only at the bottom levels narrows all the work we do from the top down."
Joi FreemanA New Vantage Point: Building a Pipeline for Multifaceted Research(ers)
March 30, 2020
"A product roadmap is a living document, it evolves with the market and users."
Victor UdoewaTheme One Intro
March 27, 2023
"If you do your job as a designer, talk to users, create great designs, it’s not enough. You need to get the strategy right."
Peter MerholzCustomer-Centered Design Organizations
June 8, 2017