Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
Gold
Thursday, March 10, 2022 • Advancing Research 2022
Share the love for this talk
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
Speakers: Daniela Magaña Flores , Ariane Rahn and Jeff Ephraim Bander
Link:

Summary

In our session we will deal with efficient and fast possibilities of UX measurement. Does the web presence or app look attractive and inspiring to new and established users? What are the strengths and weaknesses compared to the competition? We will present insights from our UX Online Benchmarking, which show that the implicit first impression is decisive. Get first insights about the eCommerce, insurance, and travel industries!

Key Insights

  • ISQUER uses a patented technology combining explicit UX ratings, NPS, and implicit reaction time measures to deliver comprehensive user experience benchmarking.

  • Implicit measurements like reaction time explain about 40% of purchase decisions, highlighting the power of capturing gut feelings in UX evaluation.

  • UX online benchmarking evaluates both users and non-users to uncover differences in perception and loyalty towards products or sites.

  • Participants explore the full live website or app freely for around three minutes, not just the homepage, allowing holistic experience assessment.

  • Home24 scores highest on appeal and inspiration, demonstrating that clean, well-structured sites generate stronger positive intuitive reactions.

  • Amazon receives higher NPS scores on mobile than desktop, indicating platform-specific performance differences in UX.

  • Ebay consistently scores low across many UX dimensions, especially among non-users, reflecting challenges in brand perception and usability.

  • Benchmarking enables product teams to quantitatively track the impact of changes by repeating studies post-optimization or relaunch.

  • About half of the UX decisions can be attributed to unconscious user processes, making implicit testing essential.

  • ISQUER’s long history since 1999 and their extensive global database support the reliability and actionability of their benchmarking results.

Notable Quotes

"UX online benchmarking offers a fast and efficient way to identify strengths and weaknesses compared to competitors."

"We combine explicit and implicit quantitative methods to fully get the user's perspective on the tested products."

"The first impression triggers unconscious processes that heavily influence purchase decisions."

"The Product React uses reaction time to capture the user’s gut feeling that otherwise remains hidden."

"Users typically rate a product better than non-users because of familiarity and built-up trust."

"Amazon performs better on mobile than on desktop according to our Net Promoter Score measurements."

"Home 24’s site feels more appealing and inspiring because it’s well structured and not overwhelming."

"The method is not just about the homepage but the whole experience the participant explores freely within minutes."

"We have been applying implicit reaction testing since 1999, which distinguishes us from many others."

"Benchmarking can be used repeatedly to track whether optimizations have the desired effect over time."

Ask the Rosenbot
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • DesignOps Summit 2022
Gold
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Brendan Jarvis
It was the Best of Times. It was the Worst of Times.
2024 • DesignOps 2024
Gold
Asia Hoe
Partnering with Product: A Journey from Junior to Senior Design
2023 • Design in Product 2023
Gold
Anna Nguyen
Why Our Voice of the Customer is Better Than Yours
2022 • Advancing Research 2022
Gold
Ignacio Martinez
Fair and Effective Designer Evaluation
2024 • DesignOps 2024
Gold
Clemens Janssen
Efficiently Scaling Research as a Team of One
2023 • Advancing Research 2023
Gold
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
Denise Jacobs
Interactive Keynote: Social Change by Design
2024 • Enterprise Experience 2020
Gold
Craig Villamor
Resilient Enterprise Design
2017 • Enterprise Experience 2017
Gold
Marjorie Stainback
What Research Ops Professionals Have Learned from COVID-19 (Videoconference)
2020 • Advancing Research Community
Joanna Vodopivec
One Research Team for All - Influence Without Authority
2022 • Advancing Research 2022
Gold
Erik Flowers
Introduction to MURAL for UX
2021 • Design at Scale 2021
Gold
Sofia Quintero
Beyond Tools: The Messy Business of Implementing Research Repositories
2022 • Advancing Research 2022
Gold
Jill Fruchter
Inconvenient Insights: The Researcher's Role is to Stay Curious
2023 • Advancing Research 2023
Gold
Sha Hwang
The Lost Year
2021 • Design at Scale 2021
Gold

More Videos

"Users’ perception predicts attrition and paid referrals — design absolutely matters when people decide to buy or go."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"The Red Queen effect means if others adapt, you must adapt or lose."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"Bias is a tendency, feeling or opinion for or against something without reason or evidence."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"It takes at least one team member to choose to set healthy standards for collaboration."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"After each interview, I input the transcript into ChatGPT and ask for three key takeaways that I can quickly share with stakeholders."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"Temporary, quick, and sometimes rough artifacts have a lifespan just long enough for the conversation they enable."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"Investing in people and fostering collaboration always pays off in stronger teams and better user experiences."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"Everyone wanted to know what was the official pattern and who was accountable for it."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"Design producers love their creative tools and want to keep using them without multiple manual reporting steps."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022