Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Learning Velocity—The Insights Speedometer (Videoconference)
Thursday, September 16, 2021 • Advancing Research Community
Share the love for this talk
Learning Velocity—The Insights Speedometer (Videoconference)
Speakers: Jen Cardello and Jennifer Otto
Link:

Summary

Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.

Key Insights

  • Fidelity shifted from measuring research output to measuring learning velocity, emphasizing how quickly the organization learns rather than how many studies are done.

  • Democratization trains designers and product partners to conduct basic usability research, freeing researchers to focus on strategic, upstream problems.

  • Initially, democratization training was intensive and hard to scale, so Fidelity created self-paced materials and a buddy approval system to maintain quality at scale.

  • Lighthouse centralizes research documents across a huge, distributed enterprise to reduce redundancy and empower product and design teams to find insights autonomously.

  • Living learning agendas linked to specific product journeys enable continuous and predictable research cycles, improving transparency and prioritization.

  • Rapid recruiting innovations, including app push notifications and online scheduling, cut participant recruitment times from 4-6 weeks to as little as an hour.

  • Strict compliance and legitimacy concerns in financial services demanded compliance-approved templates and direct outreach, improving participant trust.

  • Buddy systems in democratization not only ensure research quality but also cross-train researchers on various business areas and foster collaboration.

  • Embedding qualitative insights in collaboration platforms like Microsoft Teams supports viral sharing and empathy building within the organization.

  • Cultural readiness and curiosity at Fidelity facilitated designer uptake of democratized research despite initial fears, with scarcity and autonomy as motivators.

Notable Quotes

"It's not about doing more studies faster; that's poison. We want to help the organization learn faster."

"We spent 85% of our time doing usability testing before democratization, but now 75% is focused on right problem, right solution research."

"We went from 14 days to get research answers down to three days by enabling teams to run their own studies with buddy checks."

"Lighthouse makes everyone know where all the research lives, cutting down hours and days searching for insights."

"Rapid recruiting used to take 4 to 6 weeks; now we sometimes fill all interview slots within an hour and a half."

"Designers loved the autonomy of being able to get usability feedback in days instead of waiting weeks."

"Buddy systems ensure quality by requiring that studies cannot launch without approval from trained researchers."

"We are shifting from a mindset of output to outcomes — the value is the impact and accelerating enterprise learning."

"Our continuous discovery program sets a cadence of research every two or three weeks tied to a living learning agenda."

"Democratization is like a design system for research: it helps researchers focus more on strategic work instead of running repetitive tests."

Ask the Rosenbot
Uday Gajendar
Theme 1: Introduction
2021 • Design at Scale 2021
Gold
Briana Thomas
The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
2024 • DesignOps 2024
Gold
Kristin Skinner
Five Years of DesignOps
2021 • DesignOps Summit 2021
Gold
Ned Gartside
Navigating accessibility and climate (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Nicole Wright
Democratizing Research at HoneyBook
2022 • Advancing Research 2022
Gold
Dawn Ressel
Full-Stack User Experiences: A Marriage of Design and Technology
2016 • Enterprise UX 2016
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • DesignOps Summit 2023
Gold
Samuel Proulx
Designing beyond caricatures: Embracing real, diverse user needs
2024 • Advancing Service Design 2024
Gold
John Cutler
Prioritization for designers and product managers (1st of 3 seminars) (Videoconference)
2024 • Rosenfeld Community
Scott Stephens
The Next Generation in DesignOps Toolsets (Videoconference)
2022 • DesignOps Community
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Design at Scale 2022
Gold
Jacqui Frey
Scale is Social Work (Videoconference)
2020 • DesignOps Community
Yalenka Mariën
Designing for Digital Inclusion in the Belgian Government
2021 • Civic Design 2021
Gold
Sharon Banh
Reimagining research: What does the field need to grow? [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Bria Alexander
Opening Remarks
2022 • DesignOps Summit 2022
Gold
Peace is waged with sticky notes: Mapping Real-World Experiences
2018 • Enterprise Experience 2018
Gold

More Videos

Jennifer Kanyamibwa

"Process can make things scalable and bring folks together in ways that are not even imaginable."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Brigette Metzler

"We took a broad definition of research repositories to lessen shame and embrace the complexity."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community (Videoconference)

August 27, 2020

Carl Turner

"I like to engage my stakeholders as co-creators and co-discoverers because that makes persuasion so much easier."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

John Mortimer

"Leadership is unlocking potential in people and processes and taking responsibility for doing that."

John Mortimer Milan Guenther Lucy Ellis Patrick Quattlebaum

Panel Discussion

December 3, 2024

Dante Guintu

"Fifty percent of our designers were already active in coaching or mentoring, yet there was a call for a different mentorship flavor."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Richard Buchanan

"The new marketing is about preparing users or customers for the new kinds of products that will emerge as time moves forward."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Dan Willis

"Sharzad is going to share wisdom earned the hard way from working inside and outside."

Dan Willis

Theme 3: Intro

January 8, 2024

Dan Ward

"Innovation is novelty with impact — three words to remember."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Chris Geison

"Let’s shake s*** up."

Chris Geison

Theme Two Intro

March 28, 2023