Summary
The speaker begins by sharing his journey from computer science to a PhD in cognitive science at Stanford, and his extensive experience at startups, Yahoo, eBay, Realtor, and McAfee (now Intel Security). He stresses the critical intersection of security and user experience, aiming to improve usability in this field. He categorizes enterprise UX users into end users, admins, and buyers, underscoring their different needs and the primary shared goal of job security. Introducing a layered user experience model, he places core user needs at the center, surrounded by usability and appeal (content and look/feel). Referencing Catherine Courage’s upcoming book, he formalizes a 3D research method framework: qualitative versus quantitative, behavioral versus attitudinal, and context of use (natural, scripted, decontextualized, hybrid). He discusses popular research methods like usability labs, ethnographic field studies, interviews, big data analytics, surveys, and concept testing. Ethnographic field studies are noted as especially powerful for understanding real-world user behavior. The speaker highlights challenges in enterprise UX research, including restricted access to customers in B2B contexts, conflicting insights from varied stakeholders, and the absence of competitive pressure in internal IT teams, which can diminish UX quality. Using the fourth dimension of time, research is aligned to product development phases: strategy focusing on user needs (favoring field studies and interviews), optimization for design refinement, and assessment relying on quantitative methods. He closes by advocating a balanced mix of quantitative and qualitative approaches, emphasizing inclusion of field studies and usability labs to achieve what he terms the golden trapezoid of user research.
Key Insights
-
•
Enterprise UX involves distinct user roles: end users, admins, and buyers, each with unique needs.
-
•
A simple layered model of UX centers on user needs, surrounded by usability and appeal layers.
-
•
Qualitative methods provide rich, direct, contextual insights, while quantitative methods offer scalable, numerical measurement.
-
•
Behavioral data often differs from attitudinal data because people may be unaware of or misreport their actions.
-
•
Ethnographic field studies capture powerful real-world behaviors and workflows not accessible via surveys or labs.
-
•
In enterprise B2B contexts, sales teams often control customer access, limiting user research opportunities.
-
•
Lack of competition in internal IT environments can reduce the incentive to improve user experience.
-
•
Product development stages (strategy, optimization, assessment) guide the timing and type of research methods employed.
-
•
Field studies and interviews are vital in the strategy phase to deeply understand user needs before design.
-
•
Combining qualitative and quantitative methods across user research delivers more comprehensive insights, creating the golden trapezoid.
Notable Quotes
"Every great user experience begins with meeting a user need at its very core."
"People at Target got fired over the breach that occurred, so not getting fired is a strong motivator."
"What people say and what they do are often not the same thing, and it's not because people are liars."
"Ethnographic field studies are probably the most powerful qualitative method available."
"Having no competition can be a problem because it removes pressure to create a great user experience."
"In enterprise, buyers worry about box checking and avoiding being fired, which fragments security product adoption."
"The success metric for internal customers is often just getting the product out the door on time."
"Big data lives in the upper right corner: quantitative and behavioral methods like clickstream and A/B testing."
"Use a mix of quantitative behavioral and attitudinal methods plus field studies to get a complete picture."
"The golden trapezoid of user research happens when you combine field studies, usability labs, and quantitative data well."
Or choose a question:
More Videos
"When communities are engaged, conservation succeeds dramatically."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"We started to ask ourselves, does every new Design Ops practitioner need 10 years of experience like Lisa and I? What opportunities are we missing by not having more junior roles?"
Laine Riley Prokay Lisa GordonCarving a Path for Early Career DesignOps Practitioners
September 9, 2022
"Launching a design system is not a sprint, there’s no end, it’s always a continuous process."
Eniola OluwoleLessons From the DesignOps Journey of the World's Largest Travel Site
October 24, 2019
"Tell tight, brief stories of insights focused on impact, not on how you conducted your research."
Nathan ShedroffDouble Your Mileage: Use Your Research Strategically
March 31, 2020
"Apple premiered mobile accessibility in a very exciting way with the iPhone 3GS and VoiceOver announcement at WWDC."
Sam ProulxMobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
November 17, 2022
"The program creates predictability so teams know when to submit questions and when findings will come."
Feleesha SterlingBuilding a Rapid Research Program (Videoconference)
May 18, 2023
"Triple win cultural roles speak to what a company commits to, what users need, and wider cultural tensions."
Neil BarrieWidening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
March 25, 2024
"Leadership roles have to evolve depending on whether you’re building awareness, influence, capacity, or measuring impact."
John DevanneyThe Design Management Office
November 6, 2017
"The most important thing is producing something that gives a perspective nobody else in the organization can bring."
Katy MogalBut Do Your Insights Scale?
March 12, 2021