Summary
Research is an inherent part of design, and operationalizing how insights are generated and used is one of the more challenging aspects of design operations. Overcoming the lack of good tools, taming the complexity of research at scale, and navigating the world of different forms of inquiry are just a few of the obstacles to overcome. That said, we are starting to see a range of benefits from implementing research operations in modern design organizations.
Key Insights
-
•
Capital One views itself primarily as a tech company focused on banking, requiring a strong human-centered design approach to navigate regulations.
-
•
Banking research faces unique 'research goo' — regulatory, risk, and efficiency challenges that complicate recruiting and studying customers.
-
•
Specialized research operations roles like obs leads and risk-sharpeners help Capital One efficiently deliver research while managing compliance.
-
•
The 'wine and dine' method combines qualitative research with employee engagement to gain customer insights without typical focus group pitfalls.
-
•
Business context (B2C, B2B, internal) drastically affects user access and research approach, requiring tailored strategies.
-
•
Agile engineering workflows present challenges for user research timing; integrating design phases or Lean methodologies improves fit.
-
•
Democratizing research across roles (designers, PMs, execs) is critical to scale insight generation and avoid bottlenecks.
-
•
The UX talent pool is small and specialized; companies must design flexible job families to attract and retain varied expertise.
-
•
Qualitative research drives designers’ inspiration and problem understanding, whereas executives rely on quantitative data to make decisions.
-
•
The PURE method quantifies usability heuristics to measure ease of use, translating qualitative findings into executive-accessible metrics.
Notable Quotes
"Capital One realized four or five years ago that human-centered design needed to be a top corporate strategy."
"The number one rule when a customer filed bankruptcy is you can’t contact them in any way, making research with this group tricky."
"Risk Management sounds like one of the three circles of hell, but at Capital One, they’re amazing and help guide us through risk."
"Wine and dine is not a focus group; it’s mostly employees observing and interacting with customers in smaller, in-depth conversations."
"In business to business research, accessing the customer is often difficult because account managers act as gatekeepers."
"Developers are coming online and need something to code, which leads design teams to scramble for deliverables under Agile."
"The PURE method is like Rotten Tomatoes for usability, with experts rating tasks to generate quantitative heuristics."
"Executives want big numbers to justify decisions; they rarely look down into qualitative data for nuance."
"Qualitative data is rich and reveals why users behave a certain way; don’t misuse it with numeric summaries that teach the wrong lesson."
"Our research team’s why is a belief that opportunity lies in understanding the complexity of people, empowered by deep expertise and partnership."
Or choose a question:
More Videos
"We started doing something interesting: every Monday, instead of having a stand-up, we would journal and share."
Jennifer KanyamibwaCreating the Blueprint: Growing and Building Design Teams
November 8, 2018
"Having a repo isn’t the same as having a strategy for socializing and evangelizing the research."
Brigette Metzler Dana ChrisfieldResearch Repositories: A global project by the ResearchOps Community (Videoconference)
August 27, 2020
"A cross-functional project in name only means people report back to their management silos, not to the project team."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"If you want to bring dots closer together, you have to constantly notice how things change in the moment."
John Mortimer Milan Guenther Lucy Ellis Patrick QuattlebaumPanel Discussion
December 3, 2024
"Recruiters are often optimized for technical hiring and design is only one percent of the company’s population."
Dante GuintuHow to Crush the Talent Crunch
September 8, 2022
"Principle is an idea or value that gives unity and organization to a product, system, service, and human experience."
Richard BuchananCreativity and Principles in the Flourishing Enterprise
June 15, 2018
"Melinda Belcher has had great success first as an outside consultant and then as an inside enterprise manager."
Dan WillisTheme 3: Intro
January 8, 2024
"We study failure without blame; this is the path to progress."
Dan WardFailure Friday #1 with Dan Ward
February 7, 2025
"Generative workshops such as design sprints can devolve into political theater if we’re not careful."
Chris GeisonTheme Two Intro
March 28, 2023