Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Learning Velocity—The Insights Speedometer (Videoconference)
Thursday, September 16, 2021 • Advancing Research Community
Share the love for this talk
Learning Velocity—The Insights Speedometer (Videoconference)
Speakers: Jen Cardello and Jennifer Otto
Link:

Summary

Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.

Key Insights

  • Fidelity shifted from measuring research output to measuring learning velocity, emphasizing how quickly the organization learns rather than how many studies are done.

  • Democratization trains designers and product partners to conduct basic usability research, freeing researchers to focus on strategic, upstream problems.

  • Initially, democratization training was intensive and hard to scale, so Fidelity created self-paced materials and a buddy approval system to maintain quality at scale.

  • Lighthouse centralizes research documents across a huge, distributed enterprise to reduce redundancy and empower product and design teams to find insights autonomously.

  • Living learning agendas linked to specific product journeys enable continuous and predictable research cycles, improving transparency and prioritization.

  • Rapid recruiting innovations, including app push notifications and online scheduling, cut participant recruitment times from 4-6 weeks to as little as an hour.

  • Strict compliance and legitimacy concerns in financial services demanded compliance-approved templates and direct outreach, improving participant trust.

  • Buddy systems in democratization not only ensure research quality but also cross-train researchers on various business areas and foster collaboration.

  • Embedding qualitative insights in collaboration platforms like Microsoft Teams supports viral sharing and empathy building within the organization.

  • Cultural readiness and curiosity at Fidelity facilitated designer uptake of democratized research despite initial fears, with scarcity and autonomy as motivators.

Notable Quotes

"It's not about doing more studies faster; that's poison. We want to help the organization learn faster."

"We spent 85% of our time doing usability testing before democratization, but now 75% is focused on right problem, right solution research."

"We went from 14 days to get research answers down to three days by enabling teams to run their own studies with buddy checks."

"Lighthouse makes everyone know where all the research lives, cutting down hours and days searching for insights."

"Rapid recruiting used to take 4 to 6 weeks; now we sometimes fill all interview slots within an hour and a half."

"Designers loved the autonomy of being able to get usability feedback in days instead of waiting weeks."

"Buddy systems ensure quality by requiring that studies cannot launch without approval from trained researchers."

"We are shifting from a mindset of output to outcomes — the value is the impact and accelerating enterprise learning."

"Our continuous discovery program sets a cadence of research every two or three weeks tied to a living learning agenda."

"Democratization is like a design system for research: it helps researchers focus more on strategic work instead of running repetitive tests."

Ask the Rosenbot
Melissa Eggleston
Practical People Skills for Building Trust on Teams and with Partners
2021 • Civic Design 2021
Gold
Shanti Mathew
Civic Design at Scale: Introducing the Public Policy Layer Cake
2021 • Civic Design 2021
Gold
Uday Gajendar
The Wicked Craft of Enterprise UX
2015 • Enterprise UX 2015
Gold
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold
Sheryl Cababa
Day 2 Panel
2024 • Designing with AI 2024
Gold
Tamara Hale
War Stories LIVE! Tamara Hale
2020 • Advancing Research 2020
Gold
Alexandra Schmidt
Enterprise UX Playbook (Videoconference)
2022 • Enterprise Community
Bria Alexander
Opening Remarks
2022 • DesignOps Summit 2022
Gold
Bria Alexander
Opening Remarks
2023 • Advancing Research 2023
Gold
Edward Cupps
The Principal Path: Journeying from Management to Individual Contributor
2021 • Design at Scale 2021
Gold
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold
Peter Boersma
How to Define and Maintain a DesignOps Roadmap
2023 • DesignOps Summit 2023
Gold
Prerna Makanawala
Achieving Balanced Design Consistency
2021 • Design at Scale 2021
Gold
Shazia Ali
Communication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
April Reagan
Look, Think, Act: The Futures-Smart Design Organization
2021 • DesignOps Summit 2021
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections (Videoconference)
2019 • Enterprise Community

More Videos

Alex Hurworth

"Policies must evolve to reflect the urgency of our situation."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"Mentors are wonderful partners for feedback, collaboration, and setting employees up for success."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"People were very adverse to changes because a small 0.5% conversion increase meant millions in revenue."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"Living personas refreshed constantly with new research allow others to connect with real customer behaviors."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"Mobile browsers are typically updated with the OS, reducing variability compared to desktop browser versions."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"The program creates predictability so teams know when to submit questions and when findings will come."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"You get to those iconic signature actions when product excellence meets cultural tensions and what people need."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"We move here. We never actually become New Yorkers."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"Find the curious partners who will do some of the evangelizing for you to their peers."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021