Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Learning Velocity—The Insights Speedometer (Videoconference)
Thursday, September 16, 2021 • Advancing Research Community
Share the love for this talk
Learning Velocity—The Insights Speedometer (Videoconference)
Speakers: Jen Cardello and Jennifer Otto
Link:

Summary

Measuring the success of research efforts is a critical capability in maturing our discipline and increasing our influence. This Advancing Research call is an opportunity to hear about “learning velocity,” how it’s being applied at Fidelity Investments, and what that could mean for you. Fidelity’s Jen Cardello, head of UX Research & Insights, and Jen Otto, head of Research Operations, shares how learning velocity has become a significant outcome that drives both ResearchOps initiatives (e.g., democratization) and the way they conduct and measure the effectiveness of research at Fidelity. Jen and Jen outline what learning velocity is and how it fits into Fidelity’s outcomes-based approach to research strategy.

Key Insights

  • Fidelity shifted from measuring research output to measuring learning velocity, emphasizing how quickly the organization learns rather than how many studies are done.

  • Democratization trains designers and product partners to conduct basic usability research, freeing researchers to focus on strategic, upstream problems.

  • Initially, democratization training was intensive and hard to scale, so Fidelity created self-paced materials and a buddy approval system to maintain quality at scale.

  • Lighthouse centralizes research documents across a huge, distributed enterprise to reduce redundancy and empower product and design teams to find insights autonomously.

  • Living learning agendas linked to specific product journeys enable continuous and predictable research cycles, improving transparency and prioritization.

  • Rapid recruiting innovations, including app push notifications and online scheduling, cut participant recruitment times from 4-6 weeks to as little as an hour.

  • Strict compliance and legitimacy concerns in financial services demanded compliance-approved templates and direct outreach, improving participant trust.

  • Buddy systems in democratization not only ensure research quality but also cross-train researchers on various business areas and foster collaboration.

  • Embedding qualitative insights in collaboration platforms like Microsoft Teams supports viral sharing and empathy building within the organization.

  • Cultural readiness and curiosity at Fidelity facilitated designer uptake of democratized research despite initial fears, with scarcity and autonomy as motivators.

Notable Quotes

"It's not about doing more studies faster; that's poison. We want to help the organization learn faster."

"We spent 85% of our time doing usability testing before democratization, but now 75% is focused on right problem, right solution research."

"We went from 14 days to get research answers down to three days by enabling teams to run their own studies with buddy checks."

"Lighthouse makes everyone know where all the research lives, cutting down hours and days searching for insights."

"Rapid recruiting used to take 4 to 6 weeks; now we sometimes fill all interview slots within an hour and a half."

"Designers loved the autonomy of being able to get usability feedback in days instead of waiting weeks."

"Buddy systems ensure quality by requiring that studies cannot launch without approval from trained researchers."

"We are shifting from a mindset of output to outcomes — the value is the impact and accelerating enterprise learning."

"Our continuous discovery program sets a cadence of research every two or three weeks tied to a living learning agenda."

"Democratization is like a design system for research: it helps researchers focus more on strategic work instead of running repetitive tests."

Ask the Rosenbot
Uday Gajendar
Leading through the long tail of trauma (Videoconference)
2022 • Advancing Research Community
Brigette Metzler
Research Repositories: A global project by the ResearchOps Community (Videoconference)
2020 • Advancing Research Community
Catherine Blizzard
Using Integrated Insight to Drive Growth
2022 • Advancing Research 2022
Gold
Daniel Orbach
Zero to One: Co-Creating Operating Models with your Team
2024 • DesignOps 2024
Gold
Rebecca Topps
Planning and conducting remote usability studies for accessibility (Videoconference)
2020 • Advancing Research Community
Sam Yen
Driving Organizational Change Through Design? Do more of this and less of that
2017 • Enterprise Experience 2017
Gold
Noel Lamb
Cultivating Business Partnerships to Grow Research Ops (Videoconference)
2022 • Advancing Research Community
Gina Mendolia
Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
2024 • Advancing Service Design 2024
Gold
Dave Hora
Advice for Establishing Research (Videoconference)
2022 • Advancing Research Community
Sam Proulx
Prototype Reviews, People With Disabilities, and You
2021 • DesignOps Summit 2021
Gold
Malini Rao
Lessons Learned from a 4-year Product Re-platforming Journey
2021 • Design at Scale 2021
Gold
Xenia Adjoubei
Empowering Communities Through the Researcher in Residence Program
2023 • Advancing Research 2023
Gold
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Lada Gorlenko
Theme 1: Discussion
2024 • Enterprise Experience 2020
Gold
Giff Constable
Financial fluency for product leaders: AMA with Giff Constable (Videoconference)
2024 • Rosenfeld Community
Maggie Dieringer
Creating Consistency Through Constant Change
2024 • DesignOps Summit 2020
Gold

More Videos

"You’re born on third base but think you hit a triple — that’s the enterprise software delusion."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"There’s no such thing as one-size-fits-all methods; what works in one part of the map doesn’t work in another."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"Designing for the dominant default ignores people whose identities are marginalized or excluded."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"Taking responsibility starts with an apology and seeking regular feedback."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"Timely engagement helps stakeholders make faster, more informed decisions that lead to better business and product outcomes."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"Craft cultivates customer satisfaction, loyalty, and even forgiveness when functional issues arise."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"Relying on a single content strategist was a strategic mistake that created a single point of failure."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"If you come with a big idea, they’ll try to dial you back to the smallest iota you can test first."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"The operational glue that binds strategy, execution, and measurement in design is often missing, and that’s critical for scaling."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022