Summary
Research is an inherent part of design, and operationalizing how insights are generated and used is one of the more challenging aspects of design operations. Overcoming the lack of good tools, taming the complexity of research at scale, and navigating the world of different forms of inquiry are just a few of the obstacles to overcome. That said, we are starting to see a range of benefits from implementing research operations in modern design organizations.
Key Insights
-
•
Capital One views itself primarily as a tech company focused on banking, requiring a strong human-centered design approach to navigate regulations.
-
•
Banking research faces unique 'research goo' — regulatory, risk, and efficiency challenges that complicate recruiting and studying customers.
-
•
Specialized research operations roles like obs leads and risk-sharpeners help Capital One efficiently deliver research while managing compliance.
-
•
The 'wine and dine' method combines qualitative research with employee engagement to gain customer insights without typical focus group pitfalls.
-
•
Business context (B2C, B2B, internal) drastically affects user access and research approach, requiring tailored strategies.
-
•
Agile engineering workflows present challenges for user research timing; integrating design phases or Lean methodologies improves fit.
-
•
Democratizing research across roles (designers, PMs, execs) is critical to scale insight generation and avoid bottlenecks.
-
•
The UX talent pool is small and specialized; companies must design flexible job families to attract and retain varied expertise.
-
•
Qualitative research drives designers’ inspiration and problem understanding, whereas executives rely on quantitative data to make decisions.
-
•
The PURE method quantifies usability heuristics to measure ease of use, translating qualitative findings into executive-accessible metrics.
Notable Quotes
"Capital One realized four or five years ago that human-centered design needed to be a top corporate strategy."
"The number one rule when a customer filed bankruptcy is you can’t contact them in any way, making research with this group tricky."
"Risk Management sounds like one of the three circles of hell, but at Capital One, they’re amazing and help guide us through risk."
"Wine and dine is not a focus group; it’s mostly employees observing and interacting with customers in smaller, in-depth conversations."
"In business to business research, accessing the customer is often difficult because account managers act as gatekeepers."
"Developers are coming online and need something to code, which leads design teams to scramble for deliverables under Agile."
"The PURE method is like Rotten Tomatoes for usability, with experts rating tasks to generate quantitative heuristics."
"Executives want big numbers to justify decisions; they rarely look down into qualitative data for nuance."
"Qualitative data is rich and reveals why users behave a certain way; don’t misuse it with numeric summaries that teach the wrong lesson."
"Our research team’s why is a belief that opportunity lies in understanding the complexity of people, empowered by deep expertise and partnership."
Or choose a question:
More Videos
"Spreadsheets for profiling people across an organization can take an awful long time to create and update."
Shaping design, designers and teams
November 8, 2018
"The purpose of a design operating model is to place the customer at the centre of everything the whole organisation does."
Sabrina Mach Nina WainwrightHow to Design Your Design Operating Model
September 29, 2021
"As we age, we all face some cognitive or physical challenges. Accessibility helps our future selves."
Samuel ProulxInvisible barriers: Why accessible service design can’t be an afterthought
December 3, 2024
"It’s very overwhelming for one person to own accessibility alone; you have to build a coalition of passionate allies."
Saara Kamppari-MillerDesignOps for Inclusive Design and Accessibility (Videoconference)
May 26, 2022
"As the delivery driver, my role was connecting the dots, getting briefs, and sometimes saying no to lofty requests."
Briana ThomasThe Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
September 24, 2024
"Don't be cool, be good—work hard at managing your teams because they need you to nail it."
Adam Cutler Karen Pascoe Ian Swinson Susan WorthmanDiscussion
June 8, 2016
"I’m hoping that once we figure this out, I can kind of go back to my old goal and break those rules."
Operationalizing DesignOps
November 7, 2018
"Community is critical; solo practitioners must seek or create it to thrive and avoid isolation."
Leah Buley Joe NatoliAsk Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)
October 8, 2024
"If your budgets don’t connect to strategy goals, maybe those budget items shouldn’t exist."
Nathan ShedroffDouble Your Mileage: Use Your Research Strategically
March 31, 2020