Rosenverse
Who does what by how much?

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Who does what by how much?

Gold
Thursday, November 20, 2025 • Advancing Service Design 2025
Share the love for this talk
Who does what by how much?
Speakers: Jeff Gothelf
Link:

Summary

More than ever, we’re tasked with building ways for humans to interact more efficiently with one another, with services, with machines, and now with AI. As the toolset grows as quickly as the challenges we need to solve, how do we know we’re building the right things in the most valuable way? In this practical talk, Jeff will bring together the world of product and service design to focus on the humans in the mix and how to ensure that everything we create has a meaningful, positive impact on them.

Key Insights

  • •

    The core value equation in designing services is who does what by how much, focusing on measurable changes in human behavior as outcomes.

  • •

    Historically, learning loops to validate product value took 6-12 months, but modern digital services like Amazon enable deployment every second, allowing rapid feedback.

  • •

    Managing towards output—the delivery of products or features—often undermines true customer value and slows organizational agility.

  • •

    Effective OKRs focus on qualitative objectives describing the desired future customer state without prescribing solutions or features.

  • •

    Key results must be outcome-based metrics measuring actual behavior change rather than output milestones.

  • •

    All teams, including HR, finance, and legal, can and should use outcome-driven OKRs by focusing on how their outputs change human behavior.

  • •

    Product discovery processes like design thinking and lean UX are essential for teams to identify the right solutions in an outcome-driven OKR framework.

  • •

    AI-powered customer experiences introduce unpredictability in inputs and outputs, increasing the complexity of designing effective systems around human behavior.

  • •

    Successful OKRs require both top-down strategic alignment and bottom-up team goal setting, with negotiation to ensure cohesion.

  • •

    Changing incentive systems from rewarding output delivery to rewarding learning, evidence-based decision making, and customer centricity is crucial for OKR adoption.

Notable Quotes

"We can’t predict the future; all we can do is make the best guesses based on what we know right now."

"Amazon deploys new code into production into the hands of customers once every second."

"Managing towards outputs means someone has decided what the solution is going to be and told you to make that thing."

"Our goal ultimately is not to deploy a static solution but to make sure humans in the system achieve their goals successfully as often as possible."

"Objectives are qualitative, inspirational statements about the future we want to create for our customers without mentioning any solutions."

"Key results must be measures of human behavior and outcomes, not output metrics like 'launch this service'."

"Everyone has a customer — whether external users, third-party vendors, or internal colleagues; those humans consuming your product are your customers."

"If you don’t tell teams what to make, they need a product discovery process to decide what to build."

"Changing course based on evidence of actual human behavior is what agility really means."

"For OKRs to work, incentives have to focus on learning, customer centricity, and evidence-based decision making, not just delivery."

Ask the Rosenbot
Leisa Reichelt
The Five Dysfunctions of Democratized Research at Scale
2020 • Advancing Research 2020
Gold
Rachael Dietkus, LCSW
Everything You Need to Know about the Civic Design 2022 Call for Presentations
2022 • Civic Design Community
Emilia Åström
Unlock Your Team’s Intelligence with Collaboration Design
2022 • Design at Scale 2022
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • DesignOps Summit 2021
Gold
Jennifer Fraser
What would Emmy Noether Do? Math, Models and Mulling in UX Research
2023 • Advancing Research 2023
Gold
Peter Van Dijck
Hands-on AI #1: Let’s write your first AI eval
2025 • Rosenfeld Community
Hana Nagel
Turning Research Ripples into Waves
2018 • DesignOps Summit 2018
Gold
Mujtaba Hameed
Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research
2024 • Advancing Research 2024
Gold
Samuel Proulx
From Standards to Innovation: Why Inclusive Design Wins
2025 • Advancing Service Design 2025
Gold
Adam Thomas
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
2022 • Design in Product 2022
Gold
Uday Gajendar
Theme Four Intro
2023 • Enterprise UX 2023
Gold
Chris Moses
Stretching the Definition of DesignOps with Product Development
2018 • DesignOps Summit 2018
Gold
George Hinchliffe
Delivering Amazing Experiences
2021 • Design at Scale 2021
Gold
Kurdin Bazaz
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold
Sheryl Cababa
Expanding Your Design Lens with Systems Thinking
2023 • Enterprise Community
Caroline Jarrett
Have fun with statistics?
2024 • Rosenfeld Community

More Videos

Dave Malouf

"We hadn’t really thought about governance up front at all, which is not the ideal way to do something like that."

Dave Malouf Amy Thibodeau

Panel: Design Systems and Documentation

November 7, 2017

John Donmoyer

"If you never want to fully embed yourself in engineering, that’s fine too — you don’t have to show anyone the code you generate."

John Donmoyer

Shipping your code generation experiments to production

June 11, 2025

Clara Kliman-Silver

"When you hand over something to a machine, what is really yours? How does it affect your identity as a professional or your relationship to your work?"

Clara Kliman-Silver

UX Futures: The Role of Artificial Intelligence in Design

June 7, 2023

Mark Templeton

"Don’t dress for the job you have, dress for the job you want—this applies to people and companies alike."

Mark Templeton

Creating a Legacy: the ultimate experience

June 9, 2017

Sarah Gallimore

"Signals are something that’s happening at the horizon, percolating at the fringes of society or in a narrow subset of the population."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Sam Proulx

"You can create prototypes for screen reader users in Word, Excel, or Google Docs by simulating semantic markup."

Sam Proulx

Prototype Reviews, People With Disabilities, and You

December 8, 2021

Anna Nguyen

"It’s not all sunshine and rainbows; being new and working in a fast-moving startup means our process needs to stay flexible and adaptable."

Anna Nguyen Emily Brogan

Why Our Voice of the Customer is Better Than Yours

March 10, 2022

Anna Poznyakov

"I’m drowning trying to create an understanding of our target audience for a new feature, but that leaves me no time for usability updates."

Anna Poznyakov Richa Prajapati

Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact

March 12, 2021

Nalini P. Kotamraju

"Leadership is a mode, not a title, and anyone can be a leader."

Nalini P. Kotamraju

Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"

March 10, 2021