Rosenverse
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

Gold
Thursday, March 10, 2022 • Advancing Research 2022
Share the love for this talk
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
Speakers: Daniela Magaña Flores , Ariane Rahn and Jeff Ephraim Bander
Link:

Summary

In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!

Key Insights

  • ISQUER's UX benchmarking combines explicit (questionnaire-based) and implicit (reaction-time based) methods for a comprehensive user experience evaluation.

  • Implicit measurement captures 50% of the unconscious factors influencing purchase decisions, emphasizing the importance of gut feelings in UX.

  • Reaction time combined with agreement/disagreement responses in the Product React tool quantifies users' immediate, intuitive attitudes toward product attributes.

  • Users typically rate a product's usability and trustworthiness higher than non-users, reflecting familiarity and built relationships.

  • Net Promoter Scores vary drastically between users and non-users, indicating differing loyalties and perceptions within the same product.

  • Mobile users often rate Net Promoter Scores higher than desktop users, suggesting better mobile experiences for some ecommerce sites like Amazon.

  • ISQUER’s benchmarking surveys allow free product exploration for 3 minutes, enabling authentic interaction without restricting users to homepages only.

  • Home 24 scored highest in appeal and inspiration due to a streamlined, well-structured website design, unlike Amazon or eBay’s more cluttered pages.

  • Repeated benchmarking before and after product changes provides actionable insights to measure optimization effects over time.

  • ISQUER’s extensive database and 23 years of experience with implicit methods lend reliability and depth to benchmarking results.

Notable Quotes

"We offer a quantitative approach so you can quickly recognize the strengths and weaknesses in a product compared to competitors."

"We use a holistic methodological approach combining explicit and implicit quantitative methods to fully get the user's perspective."

"The first impression is crucial as it triggers excessive unconscious processes that influence preferences."

"Implicit methods alone can explain around 80% of the purchase decision, with half of it due to unconscious measurements."

"The faster the reaction, the less distorted it is by cognitive processes, capturing genuine gut feelings."

"Users tend to rate a familiar site better than non-users, especially for Amazon, because they feel more secure and familiar."

"Our benchmarking survey includes free exploration of the entire website or app, not just the homepage."

"Mobile users gave Amazon a higher Net Promoter Score than desktop users, indicating a better mobile experience."

"Home 24’s website is not cluttered and well-structured, explaining its higher appeal and inspiration scores."

"Doing at least two benchmarking rounds lets you see if optimizations have measurable impacts over time."

Ask the Rosenbot
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Louis Rosenfeld
Founder’s Welcome
2022 • Design in Product 2022
Gold
Tony Turner
Capturing Deep Insights
2021 • DesignOps Summit 2021
Gold
Jaime Creixems
Best Practices when Creating and Maintaining a Design System
2023 • Enterprise UX 2023
Gold
Mike Davidson
Fireside Chat
2022 • Advancing Research 2022
Gold
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
Caroline Vize
The State of UX: Five Lessons from 2021 to Accelerate Digital Experience in 2022
2022 • Advancing Research 2022
Gold
Andreas Huebner
What Is It Like To Be Part of The UX Team at Compass?
2021 • Advancing Research 2021
Gold
Josh Clark
Sentient Scenes and Radically Adaptive Experiences
2025 • Designing with AI 2025
Gold
Patrick Boehler
Fishing for Real Needs: Reimagining Journalism Needs with AI
2025 • Designing with AI 2025
Gold
Ross Smith
Breaking Barriers with Empathy
2017 • Enterprise Experience 2017
Gold
Patrizia Bertini
DesignOps + KPIs = Measure your Impact!
2024 • DesignOps Summit 2020
Gold
Jackie Velasquez-Ross
Talent Acquisition and Our Responsibility
2020 • DesignOps Community
Jess Greco
Creating a Basis for Change: Scaling Design Maturity
2022 • Design at Scale 2022
Gold
Dan Willis
Filling the Void
2018 • DesignOps Summit 2018
Gold
Megan Blocker
Panel: Excellence in Impact
2024 • Advancing Research 2024
Gold

More Videos

Surya Vanka

"Visual process maps embody cognition and allow people to step through design without becoming experts."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021

Patrick Boehler

"Small specific interventions travel further than big programs within organizations."

Patrick Boehler Madison Karas

The service shift: transforming media organizations to create real value through design

November 19, 2025

Andreas Huebner

"Leadership buy-in now means we get to focus on bigger, generative research questions instead of just tactical usability studies."

Andreas Huebner Amy Takata Craig Brookes

What Is It Like To Be Part of The UX Team at Compass?

March 11, 2021

Patrizia Bertini

"Solving one task in the design process can generate issues or benefits in different teams."

Patrizia Bertini Alexandra Mengoni León

Pushing DesignOps’ Influence into New Global Markets

September 9, 2022

Phil Gilbert

"IBM Design Thinking is about collaborating around artifacts and frameworks, not prescribing the process teams must follow."

Phil Gilbert

A Consistent Culture of Design

May 14, 2015

Yulya Besplemennova

"You need a lot of annoying handholding with the AI: reminding it of how many people you have or simple things."

Yulya Besplemennova

[Demo] Stress-testing GenAI in user research synthesis

June 4, 2024

Sarah Rink

"The best way to understand something is to become part of it."

Sarah Rink

Remote User Research: Dos and Don'ts from the Virtual Field

June 11, 2020

Mujtaba Hameed

"In this context, sometimes slower is actually faster because it allows going deeper and unlocking more meaningful insights."

Mujtaba Hameed

The new horizon of ethnography: using AI to unlock the full potential of in-person research

March 11, 2026

Sheryl Cababa

"Freedom dreaming is dreaming about a system that is free from today's oppression."

Sheryl Cababa

Living in the Clouds: Adopting a Systems Thinking Mindset

June 6, 2023