Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Measure Behaviors, Not Results
This video is featured in the UX metrics & analytics playlist.
Summary
How can design operations professionals measure success when we can’t always measure or control the results? Sometimes, even our best efforts don't lead to the outcome we expected, but that doesn’t mean the work wasn’t valuable. I believe positive feedback from stakeholders always outweighs vanity metrics. In this talk, I’ll share the core behaviors the Design & Research Operations team at Wise uses as the foundation for how our team operates. These behaviors focus on how we show up for the people we serve, for each other and importantly, for ourselves. They ultimately determine our focus and help us build trust while we deliver a positive change for the Design & Research environment across Wise. Finally, you’ll hear what we learned from a three-month experiment where we aimed to measure ourselves against these behaviors, rather than just measuring the results of our efforts. Join us as we dive into team psychology and explore why the right behaviors might actually matter more than metrics from final outcomes.
Key Insights
-
•
Measuring behaviors rather than just results can provide deeper insight into team health and trust.
-
•
Three core behaviors—delivering value now, being observant and of service, and creating visibility with clarity—form a balanced foundation for design ops.
-
•
Clear problem framing and sponsor alignment are essential for prioritization and impact in operations work.
-
•
Building trust hinges on relationship-building and understanding people’s real needs beneath their complaints or requests.
-
•
Autonomy in teams comes from aligning on strategic objectives rather than micromanaging tasks.
-
•
AI tools can dramatically speed up delivering value and impact reporting but require disciplined focus to avoid chaos.
-
•
Self-rating in work behaviors may be limited by psychological biases, but the behaviors themselves still guide improvement.
-
•
Storytelling and influence are crucial skills to gain sponsorship and support for operational initiatives.
-
•
Personal growth and energy management at work improve effectiveness and resilience, especially in complex environments.
-
•
Visibility systems for workload should be lightweight and non-distracting to maximize productivity and clarity.
Notable Quotes
"Without execution, we have no impact."
"Effort doesn’t mean progress, hard work doesn’t guarantee a harvest."
"We spend a lot of time measuring every little aspect, but how can we trust that our results show the value of our effort?"
"Maybe we can measure our behaviors, not just our results."
"The value of what we do is only really valuable if it’s recognized by others."
"Be observant means to observe what’s being said, not just what people say."
"Building relationships is essential to being of service and having impact."
"You have to be 80% impactful and 20% helpful — that’s the balance we try to maintain."
"The behaviors act as a gauge, not a scorecard, to see who is struggling and who is thriving."
"You can do everything right and still get poor results, but it’s no excuse not to do the right thing."
Or choose a question:
More Videos
"The biggest risk is bottling up emotions until you’re about to explode."
Jane Reid Janice HannawaySelf-care in User Research
April 2, 2020
"We have eight million prototyping tools but not many tools that help us spend more time in the problem space."
Andrea GallagherThe Problem Space
May 16, 2019
"It’s a muscle to build: agreeing on goals, measuring, learning, and adjusting over time to avoid wasted effort."
Christian Crumlish Aditi Ruiz Johanna Kollmann Catt SmallMorning Insights Panel
December 6, 2022
"Design operations provides the connective tissue running through different kinds of projects, making sure we have the right resources and processes."
John DevanneyThe Design Management Office
November 6, 2017
"Talent is everywhere. You find talent when you look for it without skepticism and bias."
Husani OakleyBias Towards Action: Building Teams that Build Work
June 14, 2018
"Half-day Fridays is a way for us to give back to ourselves and promote work-life balance."
Jen Crim Jess Quittner Saritha Kattekola Alex Karr Gurbani PahwaCulture, DIBS & Recruiting
June 11, 2021
"No need to take notes — our scribe David Nicholson is capturing detailed session notes and insights for you."
Bria AlexanderOpening Remarks
September 9, 2022
"One in three designers on our team is from another country — diversity improves relevance for our global users."
Meredith BlackScaling Design Culture
November 6, 2017
"Designing for marginalized communities often shows how to build scalable solutions with limited resources, saving money."
Tricia WangSCALE: Discussion
June 15, 2018
Latest Books All books
Dig deeper with the Rosenbot
How do enterprises balance qualitative and quantitative tools while integrating AI into UX research workflows?
How many books are available in the Rosenverse Gold subscription, and in what format?
What are best practices for engaging C-suite executives and physicians as champions for B2B healthcare apps?