Summary
Research is an inherent part of design, and operationalizing how insights are generated and used is one of the more challenging aspects of design operations. Overcoming the lack of good tools, taming the complexity of research at scale, and navigating the world of different forms of inquiry are just a few of the obstacles to overcome. That said, we are starting to see a range of benefits from implementing research operations in modern design organizations.
Key Insights
-
•
Capital One views itself primarily as a tech company focused on banking, requiring a strong human-centered design approach to navigate regulations.
-
•
Banking research faces unique 'research goo' — regulatory, risk, and efficiency challenges that complicate recruiting and studying customers.
-
•
Specialized research operations roles like obs leads and risk-sharpeners help Capital One efficiently deliver research while managing compliance.
-
•
The 'wine and dine' method combines qualitative research with employee engagement to gain customer insights without typical focus group pitfalls.
-
•
Business context (B2C, B2B, internal) drastically affects user access and research approach, requiring tailored strategies.
-
•
Agile engineering workflows present challenges for user research timing; integrating design phases or Lean methodologies improves fit.
-
•
Democratizing research across roles (designers, PMs, execs) is critical to scale insight generation and avoid bottlenecks.
-
•
The UX talent pool is small and specialized; companies must design flexible job families to attract and retain varied expertise.
-
•
Qualitative research drives designers’ inspiration and problem understanding, whereas executives rely on quantitative data to make decisions.
-
•
The PURE method quantifies usability heuristics to measure ease of use, translating qualitative findings into executive-accessible metrics.
Notable Quotes
"Capital One realized four or five years ago that human-centered design needed to be a top corporate strategy."
"The number one rule when a customer filed bankruptcy is you can’t contact them in any way, making research with this group tricky."
"Risk Management sounds like one of the three circles of hell, but at Capital One, they’re amazing and help guide us through risk."
"Wine and dine is not a focus group; it’s mostly employees observing and interacting with customers in smaller, in-depth conversations."
"In business to business research, accessing the customer is often difficult because account managers act as gatekeepers."
"Developers are coming online and need something to code, which leads design teams to scramble for deliverables under Agile."
"The PURE method is like Rotten Tomatoes for usability, with experts rating tasks to generate quantitative heuristics."
"Executives want big numbers to justify decisions; they rarely look down into qualitative data for nuance."
"Qualitative data is rich and reveals why users behave a certain way; don’t misuse it with numeric summaries that teach the wrong lesson."
"Our research team’s why is a belief that opportunity lies in understanding the complexity of people, empowered by deep expertise and partnership."
Dig deeper—ask the Rosenbot:
More Videos
"We did all these analyses for each market and then fit the group to be proportional to key hosting and traveling characteristics."
Wyatt HaymanGlobal Research Panels (Videoconference)
August 8, 2020
"Our UI kits are generated through JavaScript from design tokens, reducing manual errors and keeping everything up to date."
PJ Buddhari Nate BaldwinMeet Spectrum, Adobe’s Design System
June 9, 2021
"A reparations invoice artifact imagines holding largest climate change contributors accountable with multi-trillion dollar bills."
Sarah GallimoreInspire Progress with Artifacts from the Future
November 18, 2022
"Middle managers are responsible for the how—process, coordination, and communication—and you don’t see the value of that until it’s missing."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"It will be 130 years before we reach global gender equality in political power at the current rate of growth."
Dr. Jamika D. Burge Mansi GuptaAdvancing the Inclusion of Womxn in Research Practices (Videoconference)
September 15, 2022
"Product principles are minimal but help us say, oh, this is meeting that or not meeting that."
Amy MarquezINVEST: Discussion
June 15, 2018
"Game designers optimize good friction; UX tries to minimize bad friction."
Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl PlatzBeyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)
May 17, 2024
"Stop saying rest is a luxury or a privilege. It is not. It is a human right."
Zariah CameronReDesigning Wellbeing for Equitable Care in the Workplace
September 23, 2024
"Breaking tasks down into manageable chunks creates dopamine hits and makes work less overwhelming."
Jessica NorrisADHD: A DesignOps Superpower
September 9, 2022
