Summary
Research is an inherent part of design, and operationalizing how insights are generated and used is one of the more challenging aspects of design operations. Overcoming the lack of good tools, taming the complexity of research at scale, and navigating the world of different forms of inquiry are just a few of the obstacles to overcome. That said, we are starting to see a range of benefits from implementing research operations in modern design organizations.
Key Insights
-
•
Capital One views itself primarily as a tech company focused on banking, requiring a strong human-centered design approach to navigate regulations.
-
•
Banking research faces unique 'research goo' — regulatory, risk, and efficiency challenges that complicate recruiting and studying customers.
-
•
Specialized research operations roles like obs leads and risk-sharpeners help Capital One efficiently deliver research while managing compliance.
-
•
The 'wine and dine' method combines qualitative research with employee engagement to gain customer insights without typical focus group pitfalls.
-
•
Business context (B2C, B2B, internal) drastically affects user access and research approach, requiring tailored strategies.
-
•
Agile engineering workflows present challenges for user research timing; integrating design phases or Lean methodologies improves fit.
-
•
Democratizing research across roles (designers, PMs, execs) is critical to scale insight generation and avoid bottlenecks.
-
•
The UX talent pool is small and specialized; companies must design flexible job families to attract and retain varied expertise.
-
•
Qualitative research drives designers’ inspiration and problem understanding, whereas executives rely on quantitative data to make decisions.
-
•
The PURE method quantifies usability heuristics to measure ease of use, translating qualitative findings into executive-accessible metrics.
Notable Quotes
"Capital One realized four or five years ago that human-centered design needed to be a top corporate strategy."
"The number one rule when a customer filed bankruptcy is you can’t contact them in any way, making research with this group tricky."
"Risk Management sounds like one of the three circles of hell, but at Capital One, they’re amazing and help guide us through risk."
"Wine and dine is not a focus group; it’s mostly employees observing and interacting with customers in smaller, in-depth conversations."
"In business to business research, accessing the customer is often difficult because account managers act as gatekeepers."
"Developers are coming online and need something to code, which leads design teams to scramble for deliverables under Agile."
"The PURE method is like Rotten Tomatoes for usability, with experts rating tasks to generate quantitative heuristics."
"Executives want big numbers to justify decisions; they rarely look down into qualitative data for nuance."
"Qualitative data is rich and reveals why users behave a certain way; don’t misuse it with numeric summaries that teach the wrong lesson."
"Our research team’s why is a belief that opportunity lies in understanding the complexity of people, empowered by deep expertise and partnership."
Or choose a question:
More Videos
"Restoration is not just about replanting trees; it’s about rebuilding entire ecosystems."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"These brand new practitioners can bring fresh perspectives and new ways of thinking to hopefully see current problems in a new light."
Laine Riley Prokay Lisa GordonCarving a Path for Early Career DesignOps Practitioners
September 9, 2022
"You won’t know what success looks like until you put something out there and see how it works in practice."
Eniola OluwoleLessons From the DesignOps Journey of the World's Largest Travel Site
October 24, 2019
"Most strategy is done pretty poorly; it's misleading, sloppy, and often ignored after it's produced."
Nathan ShedroffDouble Your Mileage: Use Your Research Strategically
March 31, 2020
"Accessibility is an ongoing process where we iterate, improve, and expand, and mobile-first makes the journey easier."
Sam ProulxMobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
November 17, 2022
"Documentation and making findings visible even without a dedicated research librarian helps maintain program momentum."
Feleesha SterlingBuilding a Rapid Research Program (Videoconference)
May 18, 2023
"Starting with specific, meaningful priority communities rather than homogenized personas leads to powerful breakthroughs."
Neil BarrieWidening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
March 25, 2024
"Incremental improvements and disruptive innovation require very different methods and measures."
John DevanneyThe Design Management Office
November 6, 2017
"You need to understand stakeholders’ fears, motivations, and incentives to change hearts and minds."
Katy MogalBut Do Your Insights Scale?
March 12, 2021