Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

Gold
Thursday, March 10, 2022 • Advancing Research 2022
Share the love for this talk
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
Speakers: Daniela Magaña Flores , Ariane Rahn and Jeff Ephraim Bander
Link:

Summary

In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!

Key Insights

  • ISQUER's UX benchmarking combines explicit (questionnaire-based) and implicit (reaction-time based) methods for a comprehensive user experience evaluation.

  • Implicit measurement captures 50% of the unconscious factors influencing purchase decisions, emphasizing the importance of gut feelings in UX.

  • Reaction time combined with agreement/disagreement responses in the Product React tool quantifies users' immediate, intuitive attitudes toward product attributes.

  • Users typically rate a product's usability and trustworthiness higher than non-users, reflecting familiarity and built relationships.

  • Net Promoter Scores vary drastically between users and non-users, indicating differing loyalties and perceptions within the same product.

  • Mobile users often rate Net Promoter Scores higher than desktop users, suggesting better mobile experiences for some ecommerce sites like Amazon.

  • ISQUER’s benchmarking surveys allow free product exploration for 3 minutes, enabling authentic interaction without restricting users to homepages only.

  • Home 24 scored highest in appeal and inspiration due to a streamlined, well-structured website design, unlike Amazon or eBay’s more cluttered pages.

  • Repeated benchmarking before and after product changes provides actionable insights to measure optimization effects over time.

  • ISQUER’s extensive database and 23 years of experience with implicit methods lend reliability and depth to benchmarking results.

Notable Quotes

"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."

"We use a holistic methodological approach combining explicit and implicit quantitative methods to fully get the user's perspective."

"The first impression is crucial as it triggers excessive unconscious processes that influence preferences."

"Implicit methods alone can explain around 80% of the purchase decision, with half of it due to unconscious measurements."

"The faster the reaction, the less distorted it is by cognitive processes, capturing genuine gut feelings."

"Users tend to rate a familiar site better than non-users, especially for Amazon, because they feel more secure and familiar."

"Our benchmarking survey includes free exploration of the entire website or app, not just the homepage."

"Mobile users gave Amazon a higher Net Promoter Score than desktop users, indicating a better mobile experience."

"Home 24’s website is not cluttered and well-structured, explaining its higher appeal and inspiration scores."

"Doing at least two benchmarking rounds lets you see if optimizations have measurable impacts over time."

Ask the Rosenbot
Rachel Radway
The Many Paths Of Design Operations
2022 • DesignOps Summit 2022
Gold
Sara Logel
Your Colleagues are Your Users Too
2023 • Advancing Research 2023
Gold
Chui Chui Tan
Global insights: Embracing international and intercultural research for innovation
2025 • Advancing Research 2025
Gold
Kristin Skinner
Group Activity: A Deep Dive Into Value and Outcomes
2019 • DesignOps Summit 2019
Gold
Erin Weigel
Testing and Experimentation Tools
2026 • Advancing Research 2026
Gold
Uday Gajendar
The Wicked Craft of Enterprise UX
2015 • Enterprise UX 2015
Gold
Sam Proulx
Everything You Ever Wanted to Know About Screen Readers
2021 • Design at Scale 2021
Gold
Bria Alexander
Opening Remarks Day 1
2024 • Advancing Research 2024
Gold
Robin Beers
Beyond Insights: Researchers as Organizational Change Catalysts
2024 • Advancing Research 2024
Gold
Sara Conklin
A UXer’s 12-Month Journey from Climate Concern to Climate Credibility
2025 • Climate UX Interest Group
Ryan Rumsey
Business Influence Without Losing Your Soul
2021 • Enterprise Community
Caroline Vize
The State of UX: Five Lessons from 2021 to Accelerate Digital Experience in 2022
2022 • Advancing Research 2022
Gold
Jennifer Fraser
What would Emmy Noether Do? Math, Models and Mulling in UX Research
2023 • Advancing Research 2023
Gold
Kit Unger
Theme 2: Introduction
2021 • Design at Scale 2021
Gold
Llewyn Paine
Day 1 Using AI in UX with Impact
2025 • Designing with AI 2025
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Advancing Research 2023
Gold

More Videos

Xenia Adjoubei

"We were interested in supporting networks of self-organization and mutual aid formed between refugees and host communities."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

Tamara Kartoziia

"The focus isn’t on head to head competition, but on specialization and differentiation in the Italian market."

Tamara Kartoziia

Think global, adapt local: how service design accelerated B2B market entry by 6 months

November 20, 2025

Jay Bustamante

"We are the solution to preventing harmful AI outcomes like Robert's wrongful arrest."

Jay Bustamante

Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation

October 2, 2023

Nicole Aleong

"Potential refers to not yet actualized possibilities that may or may not come to fruition."

Nicole Aleong

Future Orientations to Everyday Life: Futures Anthropology as a Methodology

March 26, 2024

Nick Lewis

"Be curious, keep learning, and believe you can make a difference in sustainability."

Nick Lewis

Designing and building low-carbon websites independently

November 18, 2025

Vicky Teinaki

"Accepting that data can be our friend enables us to argue design decisions with real numbers."

Vicky Teinaki Michele Marut Tim Parmee

Short Take #3: UX/Product Lessons from Your Industry Peers

December 6, 2022

Laura Weiss

"Conflict occurs when something important to us feels threatened or disrespected."

Laura Weiss

Turn Down the Heat: 3 Ways to Handle Conflict in the Moment

November 20, 2024

Joerg Beringer

"You get a lot of different research outputs in a matter of minutes from your scope input."

Joerg Beringer Thomas Geis

Scaling User Research with AI: Continuous Discovery of User Needs in Minutes

June 10, 2025

Shelby Switzer

"You can’t have a hackathon without free food."

Shelby Switzer

Making Space for Community Knowledge-sharing in a Distributed World

December 10, 2021