Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Learning Velocity—The Insights Speedometer (Videoconference)
Thursday, September 16, 2021 • Advancing Research Community
Share the love for this talk
Learning Velocity—The Insights Speedometer (Videoconference)
Speakers: Jen Cardello and Jennifer Otto
Link:

Summary

Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.

Key Insights

  • Fidelity shifted from measuring research output to measuring learning velocity, emphasizing how quickly the organization learns rather than how many studies are done.

  • Democratization trains designers and product partners to conduct basic usability research, freeing researchers to focus on strategic, upstream problems.

  • Initially, democratization training was intensive and hard to scale, so Fidelity created self-paced materials and a buddy approval system to maintain quality at scale.

  • Lighthouse centralizes research documents across a huge, distributed enterprise to reduce redundancy and empower product and design teams to find insights autonomously.

  • Living learning agendas linked to specific product journeys enable continuous and predictable research cycles, improving transparency and prioritization.

  • Rapid recruiting innovations, including app push notifications and online scheduling, cut participant recruitment times from 4-6 weeks to as little as an hour.

  • Strict compliance and legitimacy concerns in financial services demanded compliance-approved templates and direct outreach, improving participant trust.

  • Buddy systems in democratization not only ensure research quality but also cross-train researchers on various business areas and foster collaboration.

  • Embedding qualitative insights in collaboration platforms like Microsoft Teams supports viral sharing and empathy building within the organization.

  • Cultural readiness and curiosity at Fidelity facilitated designer uptake of democratized research despite initial fears, with scarcity and autonomy as motivators.

Notable Quotes

"It's not about doing more studies faster; that's poison. We want to help the organization learn faster."

"We spent 85% of our time doing usability testing before democratization, but now 75% is focused on right problem, right solution research."

"We went from 14 days to get research answers down to three days by enabling teams to run their own studies with buddy checks."

"Lighthouse makes everyone know where all the research lives, cutting down hours and days searching for insights."

"Rapid recruiting used to take 4 to 6 weeks; now we sometimes fill all interview slots within an hour and a half."

"Designers loved the autonomy of being able to get usability feedback in days instead of waiting weeks."

"Buddy systems ensure quality by requiring that studies cannot launch without approval from trained researchers."

"We are shifting from a mindset of output to outcomes — the value is the impact and accelerating enterprise learning."

"Our continuous discovery program sets a cadence of research every two or three weeks tied to a living learning agenda."

"Democratization is like a design system for research: it helps researchers focus more on strategic work instead of running repetitive tests."

Ask the Rosenbot
Emily Williams
When UX Research and Institutional Racism Collide: A Case Study
2021 • Advancing Research 2021
Gold
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Anna Avrekh
Diversity In and For Design: Building Conscious Diversity in Design and Research
2021 • Design at Scale 2021
Gold
Brad Orego
Bringing Customer Research to More Internal Teams
2022 • Advancing Research 2022
Gold
Lisanne Norman
Why I Left Research
2023 • Advancing Research 2023
Gold
Nalini Kotamraju
Research After UX
2024 • Advancing Research 2024
Gold
Jorge Arango
[Demo] How to re-categorize content at scale using LLMs
2024 • Designing with AI 2024
Gold
Meaghan Waters
Lack of Product Thinking will Doom Your Legacy Modernization
2021 • Design at Scale 2021
Gold
Billy Carlson
Principles of Team Wireframing
2023 • DesignOps Summit 2023
Gold
Susan Weinschenk
Evaluating the Maturity of UX in Your Organization (Videoconference)
2020 • Enterprise Community
Peter Merholz
The Trials and Tribulations of Directors of UX (Videoconference)
2023 • Enterprise Community
Ali Jeffery
How DesignOps Helped Enable Wall Street to Work Remotely
2020 • DesignOps Summit 2020
Gold
How to Identify and Increase your "Experience Quotient"
2018 • Enterprise Experience 2018
Gold
Sarah Barrett
AI in Real Life: Using LLMs to Turbocharge Microsoft Learn
2025 • Rosenfeld Community
Lisa Spitz
Building Trust Through Equitable Research Practices
2022 • Civic Design 2022
Gold
James Rampton
The Basics of Automotive UX & Why Phones Are a Part of That Future
2024 • Rosenfeld Community

More Videos

Adam Cutler

"A 101 conversation over coffee yields better insights than written reviews in 360 assessments."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"If you’re doing a lot of work that’s not in your job description, you might actually be doing leadership."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"In the automotive industry, most safety standards only became mandatory after governments intervened."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"Transportation must evolve to be more sustainable and accessible for all."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"If you forget the individual, you cut out psychological safety, and that’s the foundation of strong teams."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"It’s human infrastructure—community organizing, unions, activists—that saves the day when other infrastructures break down."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"Research should be done the same way products are built, with stakeholders as your users."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"With proper maintenance, knowledge becomes a vehicle that probes the most hidden spaces of possibility and brings the best decisions to the surface."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"Most product teams work linearly, but systems thinking captures the real-world complexity of moving forward and sometimes stepping back."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024