Summary
There is nothing more frustrating than dedicating your blood, sweat, and tears to developing a product, only to see it shut down for no particular reason. We still lack standards for measuring potential opportunities and solutions—so leadership continues to base decisions on intuition, personal experience, and other factors that often barely correlate with success. Organizations large and small need agreed-upon measures of potential product-market fit for their concepts and solutions, ones that help establish unmet needs and lead to designs that users understand and want to use. The DesignOps team at Athenahealth has solved this problem by creating a standardized measurement framework—including qualitative and quantitative instruments—that helps product teams measure their concepts and solutions early and often. These are measures that leaders can use to make informed investment decisions across the larger portfolio, and that free product teams to be awesome at what they do: designing, managing, and developing products that lead to better experiences for users.
Key Insights
-
•
Scaling design impact is about quality and meaningful organizational outcomes, not just quantity or presence.
-
•
Lack of clear decision rationale causes teams to lose agency, leading to poor behaviors like skunkworks and cutting corners.
-
•
Government-subsidized demand in healthcare allows poor software to succeed despite low user satisfaction.
-
•
Users in enterprise healthcare software often feel trapped with high switching costs and limited influence on purchasing.
-
•
Proving design’s impact through correlation between user perception data and business outcomes drives investment.
-
•
Creating a shared design language using Nielsen’s heuristics helps cross-disciplinary teams evaluate and improve workflows.
-
•
Regular scoring sessions with product, design, and subject experts help calibrate understanding and prioritize issues.
-
•
Redesigning product decision-making to empower autonomy improves pivot/shelve choices and team engagement.
-
•
Concept validation surveys that test perceived usefulness and intent to use prevent investment in unwanted features.
-
•
Enterprise software delusion occurs when companies mistake market dynamics for successful product experience.
Notable Quotes
"Scale isn’t just about quantity, it’s about the quality and impact you have on the outcomes of the organization."
"When teams lose a sense of agency, they act strange, cutting corners and racing to get something out the door."
"Doctors hate using EHRs because it turns them into clerks, interacting more with machines than patients."
"You’re born on third base but think you hit a triple — that’s the enterprise software delusion."
"If design didn’t move the needle, we wouldn’t be having this conversation."
"Users’ perception predicts attrition and paid referrals — design absolutely matters when people decide to buy or go."
"Teaching product managers heuristics took 15 minutes, and now they use that shared language to articulate design."
"We want teams to have autonomy and power to make pivot, shelve, and proceed decisions, not leadership dictating."
"Concept validation lets us objectively decide which features to build based on perceived usefulness and intent to use."
"There’s never enough attention you can give to change management in scaling design impact — don’t do it alone."
Dig deeper—ask the Rosenbot:
More Videos
"Benchmarking can be used repeatedly to track whether optimizations have the desired effect over time."
Daniela Magaña Flores Ariane Rahn Jeff Ephraim BanderAhead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
March 10, 2022
"The art of prompt design shares a strong connection with the art of conducting interviews and creating discussion guides."
Savina HawkinsHarnessing AI in UXR: Practical Strategies for Positive Impact
March 26, 2024
"Knowledge is power; empowering communities leads to better conservation outcomes."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"Democratizing knowledge access means more people can fact-check and avoid taking research out of context."
Matt DuignanHITS, Microsoft's internal human insight system: From research library to living body of knowledge (Videoconference)
July 16, 2019
"Make it easy to do the right thing, and as a side effect, make it harder to do the wrong thing - guiding principle from Salesforce Lightning Design System."
Craig VillamorDesign Systems for Ethical Design (Videoconference)
January 26, 2023
"Break up your long-term vision into quarterly goals you can celebrate to preserve sanity and bring your stakeholders along."
Ovetta SampsonTurning UX Passion into Real Product Influence
June 7, 2023
"To advance design maturity, you need a tight business partnership between product management and design ops leaders."
Rima Campbell Amrit S BhachuIncrease Productivity and Drive Business Impact
September 24, 2024
"Design ops teams are mostly a team of one, so many of you are probably in the same boat I was."
Amy Gawronski ZuccaroAdvice for DesignOps Employee #1
September 29, 2021
"If you don’t remember anything else, remember that colonial ways of knowing and valuing will never produce liberatory methodologies."
Victor UdoewaBeyond Methods and Diversity: The Roots of Inclusion
March 26, 2024
