Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Standardizing Product Merits for Leaders, Designers, and Everyone
Gold
Friday, June 15, 2018 • Enterprise Experience 2018
Share the love for this talk
Link:

Summary

There is nothing more frustrating than dedicating your blood, sweat, and tears to developing a product, only to see it shut down for no particular reason. We still lack standards for measuring potential opportunities and solutions—so leadership continues to base decisions on intuition, personal experience, and other factors that often barely correlate with success. Organizations large and small need agreed-upon measures of potential product-market fit for their concepts and solutions, ones that help establish unmet needs and lead to designs that users understand and want to use. The DesignOps team at Athenahealth has solved this problem by creating a standardized measurement framework—including qualitative and quantitative instruments—that helps product teams measure their concepts and solutions early and often. These are measures that leaders can use to make informed investment decisions across the larger portfolio, and that free product teams to be awesome at what they do: designing, managing, and developing products that lead to better experiences for users.

Key Insights

  • Scaling design impact is about quality and meaningful organizational outcomes, not just quantity or presence.

  • Lack of clear decision rationale causes teams to lose agency, leading to poor behaviors like skunkworks and cutting corners.

  • Government-subsidized demand in healthcare allows poor software to succeed despite low user satisfaction.

  • Users in enterprise healthcare software often feel trapped with high switching costs and limited influence on purchasing.

  • Proving design’s impact through correlation between user perception data and business outcomes drives investment.

  • Creating a shared design language using Nielsen’s heuristics helps cross-disciplinary teams evaluate and improve workflows.

  • Regular scoring sessions with product, design, and subject experts help calibrate understanding and prioritize issues.

  • Redesigning product decision-making to empower autonomy improves pivot/shelve choices and team engagement.

  • Concept validation surveys that test perceived usefulness and intent to use prevent investment in unwanted features.

  • Enterprise software delusion occurs when companies mistake market dynamics for successful product experience.

Notable Quotes

"Scale isn’t just about quantity, it’s about the quality and impact you have on the outcomes of the organization."

"When teams lose a sense of agency, they act strange, cutting corners and racing to get something out the door."

"Doctors hate using EHRs because it turns them into clerks, interacting more with machines than patients."

"You’re born on third base but think you hit a triple — that’s the enterprise software delusion."

"If design didn’t move the needle, we wouldn’t be having this conversation."

"Users’ perception predicts attrition and paid referrals — design absolutely matters when people decide to buy or go."

"Teaching product managers heuristics took 15 minutes, and now they use that shared language to articulate design."

"We want teams to have autonomy and power to make pivot, shelve, and proceed decisions, not leadership dictating."

"Concept validation lets us objectively decide which features to build based on perceived usefulness and intent to use."

"There’s never enough attention you can give to change management in scaling design impact — don’t do it alone."

Ask the Rosenbot
Spencer L. A. Stultz
Why Social Justice Frameworks are Necessary for Successful DEI/JEDI Initiatives
2023 • DesignOps Summit 2023
Gold
Erin Malone
Understanding the past to prepare for the future
2024 • Rosenfeld Community
Jerome “Axle” Brown
How to Use Self-Directed Learning to Ensure Your Research Insights are Heard and Acted Upon
2021 • Advancing Research 2021
Gold
Jennifer Strickland
Fireside Chat: How Design Addresses a World on Fire (Videoconference)
2022 • Civic Design Community
Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold
Ned Dwyer
The Intersection of Design and ResearchOps
2024 • DesignOps 2024
Gold
Jayne Engle
Civic Design for the Next Seven Generations—A Discussion on Sacred Civics (Videoconference)
2022 • Civic Design Community
Sean McKay
Whole Product Thinking: Expanding beyond problem and solution space thinking (Videoconference)
2024 • Rosenfeld Community
Louis Rosenfeld
Founder’s Welcome
2022 • Design in Product 2022
Gold
Surya Vanka
Unleashing Swarm Creativity to Solve Enterprise Challenges
2021 • Design at Scale 2021
Gold
Marc Majers
Interrupted UX - Add A Dose of Reality To Usability Testing
2022 • Advancing Research 2022
Gold
Erin Weigel
Get Your Whole Team Testing to Design for Impact
2024 • Rosenfeld Community
Dem Gerolemou
Climate technology fundamentals (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Louis Rosenfeld
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Sofía Delsordo
Public Policy for Jalisco's Designers to Make Design Matter
2021 • Civic Design 2021
Gold

More Videos

"Spreadsheets for profiling people across an organization can take an awful long time to create and update."

Shaping design, designers and teams

November 8, 2018

Sabrina Mach

"Design often ends up being a means to fix what development has already delivered."

Sabrina Mach Nina Wainwright

How to Design Your Design Operating Model

September 29, 2021

Samuel Proulx

"Disability isn’t a problem with a person; it’s something that happens when we fail to enable them."

Samuel Proulx

Invisible barriers: Why accessible service design can’t be an afterthought

December 3, 2024

Saara Kamppari-Miller

"By designing products through the lens of edge cases like disabilities first, they can often become better products for everyone."

Saara Kamppari-Miller

DesignOps for Inclusive Design and Accessibility (Videoconference)

May 26, 2022

Briana Thomas

"We didn’t chase shiny objects; we gave creatives access to tools to inspire the future of creativity."

Briana Thomas

The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams

September 24, 2024

Adam Cutler

"Can you show me your process, not just your portfolio? That shows me your real design thinking."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

"We had to partner closely with information security to ensure every piece of data in research files was tracked and compliant."

Operationalizing DesignOps

November 7, 2018

Leah Buley

"This is not brain cancer. Nobody dies if we get it wrong — the worst is taking a different approach."

Leah Buley Joe Natoli

Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)

October 8, 2024

Nathan Shedroff

"Rather than aiming for the chief strategy officer directly, build relationships with junior strategists who are more accessible."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020