Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Learning Velocity—The Insights Speedometer (Videoconference)
Thursday, September 16, 2021 • Advancing Research Community
Share the love for this talk
Learning Velocity—The Insights Speedometer (Videoconference)
Speakers: Jen Cardello and Jennifer Otto
Link:

Summary

Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.

Key Insights

  • Fidelity shifted from measuring research output to measuring learning velocity, emphasizing how quickly the organization learns rather than how many studies are done.

  • Democratization trains designers and product partners to conduct basic usability research, freeing researchers to focus on strategic, upstream problems.

  • Initially, democratization training was intensive and hard to scale, so Fidelity created self-paced materials and a buddy approval system to maintain quality at scale.

  • Lighthouse centralizes research documents across a huge, distributed enterprise to reduce redundancy and empower product and design teams to find insights autonomously.

  • Living learning agendas linked to specific product journeys enable continuous and predictable research cycles, improving transparency and prioritization.

  • Rapid recruiting innovations, including app push notifications and online scheduling, cut participant recruitment times from 4-6 weeks to as little as an hour.

  • Strict compliance and legitimacy concerns in financial services demanded compliance-approved templates and direct outreach, improving participant trust.

  • Buddy systems in democratization not only ensure research quality but also cross-train researchers on various business areas and foster collaboration.

  • Embedding qualitative insights in collaboration platforms like Microsoft Teams supports viral sharing and empathy building within the organization.

  • Cultural readiness and curiosity at Fidelity facilitated designer uptake of democratized research despite initial fears, with scarcity and autonomy as motivators.

Notable Quotes

"It's not about doing more studies faster; that's poison. We want to help the organization learn faster."

"We spent 85% of our time doing usability testing before democratization, but now 75% is focused on right problem, right solution research."

"We went from 14 days to get research answers down to three days by enabling teams to run their own studies with buddy checks."

"Lighthouse makes everyone know where all the research lives, cutting down hours and days searching for insights."

"Rapid recruiting used to take 4 to 6 weeks; now we sometimes fill all interview slots within an hour and a half."

"Designers loved the autonomy of being able to get usability feedback in days instead of waiting weeks."

"Buddy systems ensure quality by requiring that studies cannot launch without approval from trained researchers."

"We are shifting from a mindset of output to outcomes — the value is the impact and accelerating enterprise learning."

"Our continuous discovery program sets a cadence of research every two or three weeks tied to a living learning agenda."

"Democratization is like a design system for research: it helps researchers focus more on strategic work instead of running repetitive tests."

Kim Fellman Cohen
Measuring the Designer Experience
2019 • DesignOps Summit 2019
Gold
Raven Veal
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
2021 • Advancing Research 2021
Gold
Angy Peterson
More Than Technology: Personalized Public Sector Experiences
2021 • Civic Design 2021
Gold
Sarah Alvarado
How to make UX research leadership more effective [Advancing Research Community Workshop Series] (Videoconference)
2023 • Advancing Research Community
Sam Yen
Driving Organizational Change Through Design? Do more of this and less of that
2017 • Enterprise Experience 2017
Gold
Amanda Kaleta-Kott
The Joys and Dilemmas of Conducting UX Research with Older Adults
2022 • Advancing Research 2022
Gold
Heidi Trost
To Protect People, You Have to Protect Information: A Human-Centered Design Approach to Cybersecurity
2025 • Rosenfeld Community
Alfred Kahn
A Seat at the Table: Making Your Team a Strategic Partner
2023 • Design in Product 2023
Gold
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka (Videoconference)
2021 • Civic Design Community
Michelle Morrison
Practice What You Preach
2024 • DesignOps Summit 2020
Gold
Stephen Pollard
Closing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
2017 • DesignOps Summit 2017
Gold
Amber Knabl
Empowering innovation: The critical role of inclusive product development in the AI era
2024 • Designing with AI 2024
Gold
Matt Bernius
Trauma-informed Research: A Panel Discussion (Videoconference)
2021 • Advancing Research Community
Alison Rand
Scaling Impact with Service Design (Videoconference)
2021 • DesignOps Community
Louis Rosenfeld
The Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld
2024 • Designing with AI 2024
Gold
Caroline Jarrett
Have fun with statistics?
2024 • Rosenfeld Community

More Videos

Wyatt Hayman

"One of the coolest things is that product managers without formal research backgrounds can quickly talk to hosts across six countries without recruiting hassle."

Wyatt Hayman

Global Research Panels (Videoconference)

August 8, 2020

PJ Buddhari

"We have a Spectrum Guild that includes product designers and managers from every business unit to surface major changes and requests."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

Sarah Gallimore

"When we stick to just verbal descriptions, a lot of nuance about future experiences gets lost."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Peter Merholz

"We don’t get upset when users say one thing and do another, but we freak out when our leadership behaves that way."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Dr. Jamika D. Burge

"We need to be radically honest about who was in the research rather than blindly trusting generalized findings."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices (Videoconference)

September 15, 2022

Amy Marquez

"Don’t advertise to kids. That’s a belief we stick to even when it’s uncomfortable."

Amy Marquez

INVEST: Discussion

June 15, 2018

Dane DeSutter

"If you remove death in a game like Dark Souls, the game breaks — death is part of the challenge and fun."

Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl Platz

Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)

May 17, 2024

Zariah Cameron

"A kickback is a free flowing and life giving gathering that transforms and electrifies throughout the night."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

Jessica Norris

"If goals aren’t met, remember it’s about the team, not just the individual; many factors are out of your control."

Jessica Norris

ADHD: A DesignOps Superpower

September 9, 2022