Standardizing Product Merits for Leaders, Designers, and Everyone
Summary
The DesignOps team at Athenahealth has solved this problem by creating a standardized measurement framework—including qualitative and quantitative instruments—that helps product teams measure their concepts and solutions early and often. These are measures that leaders can use to make informed investment decisions across the larger portfolio, and that free product teams to be awesome at what they do: designing, managing, and developing products that lead to better experiences for users.
Key Insights
-
•
Scale should be measured by the quality and meaningful impact of design, not just quantity or organizational reach.
-
•
Lack of team agency in decision-making leads to unhealthy behaviors like cutting corners and skunk works projects.
-
•
Athena Health flourished initially due to government-subsidized demand rather than superior user experience.
-
•
Physicians using EHR systems often feel like clerks, frustrated by poor usability and forced workflows.
-
•
Enterprise software delusion occurs when companies succeed despite poor design due to weak competition and high switching costs.
-
•
Proving design impacts business outcomes requires identifying and analyzing key metrics like user retention and referrals.
-
•
Creating a shared design language involving product managers and subject matter experts fosters organizational alignment.
-
•
Systematic workflow audits guided by Jakob Nielsen’s heuristics can uncover actionable improvements to complex software.
-
•
Redesigning product decision-making to empower teams early in the process accelerates better pivot, shelve, or proceed calls.
-
•
Introducing self-serve experience measurement tools, including concept validation surveys, supports evidence-driven design iterations.
Notable Quotes
"Scale isn’t just about quantity, it’s about the quality and impact you have on organizational outcomes."
"So much change was killed just because leadership said so, and that really breaks my heart."
"Doctors don’t like using EHRs because it turns them into clerks; they’re engaging with a machine instead of a patient."
"You’re born on third base but think you hit a triple—that’s the enterprise software delusion."
"Users aren’t happy because they’re trapped; they have no sense of agency over the software they use."
"If design doesn’t move the needle, what needle are we even talking about? You have to find that needle."
"Creating a shared language lets others articulate design issues and makes design part of the conversation."
"Redesigning decision making means teams should have the autonomy to recommend pivot, shelve, or proceed earlier."
"We cut the claims editing process in half—four pages and 10 steps down to one page and four steps."
"Concept validation helps us spend time building useful things before making them work well."
Or choose a question:
More Videos
"I spent too much time trying to change company culture and should have focused more on just getting things done."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"The Library of Congress web presence was a findability nightmare, like the Winchester Mystery House."
Peter MorvilleThe Architecture of Understanding
May 13, 2015
"I was kind of wandering around aimlessly trying to find the next job."
Renee ReidBecoming a ResearchH.E.R (Highly Enterprise Ready)
June 3, 2019
"Gesture and embodied actions will be a key tool for understanding user experience as computing moves beyond traditional screen-based interactions."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
"A good two-factor system offers multiple methods, like authenticator apps, calls, and texts, with generous timeouts."
Sam ProulxOnline Shopping: Designing an Accessible Experience
October 3, 2023
"A poor experience on a web visit isn’t out of sight, out of mind; it impacts their entire history with the brand."
Andrew Custage Michael MallettThe Digital Journey: Research on Consumer Frustration and Loyalty
March 29, 2023
"The nitty gritty is a space to become resources for each other so people know who to talk to when they have questions."
Shelby SwitzerMaking Space for Community Knowledge-sharing in a Distributed World
December 10, 2021
"We should think of AI as something that amplifies what we already are: if we think research is about impact, AI will help us understand and track it."
Llewyn PaineCoexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
March 11, 2025
"The techno-optimist hacker lens believes growth is the only metric that matters, enabling disruption but causing blind spots."
Robin BeersNavigating organizational systems: Rethinking researcher’s role in driving change
March 13, 2025
