Summary
The speaker begins by sharing his journey from computer science to a PhD in cognitive science at Stanford, and his extensive experience at startups, Yahoo, eBay, Realtor, and McAfee (now Intel Security). He stresses the critical intersection of security and user experience, aiming to improve usability in this field. He categorizes enterprise UX users into end users, admins, and buyers, underscoring their different needs and the primary shared goal of job security. Introducing a layered user experience model, he places core user needs at the center, surrounded by usability and appeal (content and look/feel). Referencing Catherine Courage’s upcoming book, he formalizes a 3D research method framework: qualitative versus quantitative, behavioral versus attitudinal, and context of use (natural, scripted, decontextualized, hybrid). He discusses popular research methods like usability labs, ethnographic field studies, interviews, big data analytics, surveys, and concept testing. Ethnographic field studies are noted as especially powerful for understanding real-world user behavior. The speaker highlights challenges in enterprise UX research, including restricted access to customers in B2B contexts, conflicting insights from varied stakeholders, and the absence of competitive pressure in internal IT teams, which can diminish UX quality. Using the fourth dimension of time, research is aligned to product development phases: strategy focusing on user needs (favoring field studies and interviews), optimization for design refinement, and assessment relying on quantitative methods. He closes by advocating a balanced mix of quantitative and qualitative approaches, emphasizing inclusion of field studies and usability labs to achieve what he terms the golden trapezoid of user research.
Key Insights
-
•
Enterprise UX involves distinct user roles: end users, admins, and buyers, each with unique needs.
-
•
A simple layered model of UX centers on user needs, surrounded by usability and appeal layers.
-
•
Qualitative methods provide rich, direct, contextual insights, while quantitative methods offer scalable, numerical measurement.
-
•
Behavioral data often differs from attitudinal data because people may be unaware of or misreport their actions.
-
•
Ethnographic field studies capture powerful real-world behaviors and workflows not accessible via surveys or labs.
-
•
In enterprise B2B contexts, sales teams often control customer access, limiting user research opportunities.
-
•
Lack of competition in internal IT environments can reduce the incentive to improve user experience.
-
•
Product development stages (strategy, optimization, assessment) guide the timing and type of research methods employed.
-
•
Field studies and interviews are vital in the strategy phase to deeply understand user needs before design.
-
•
Combining qualitative and quantitative methods across user research delivers more comprehensive insights, creating the golden trapezoid.
Notable Quotes
"Every great user experience begins with meeting a user need at its very core."
"People at Target got fired over the breach that occurred, so not getting fired is a strong motivator."
"What people say and what they do are often not the same thing, and it's not because people are liars."
"Ethnographic field studies are probably the most powerful qualitative method available."
"Having no competition can be a problem because it removes pressure to create a great user experience."
"In enterprise, buyers worry about box checking and avoiding being fired, which fragments security product adoption."
"The success metric for internal customers is often just getting the product out the door on time."
"Big data lives in the upper right corner: quantitative and behavioral methods like clickstream and A/B testing."
"Use a mix of quantitative behavioral and attitudinal methods plus field studies to get a complete picture."
"The golden trapezoid of user research happens when you combine field studies, usability labs, and quantitative data well."
Or choose a question:
More Videos
"Every one of those hundred teams self-selected in. They want in and they’re trying to do the right thing."
Marc Rettig Julie Baher Phil Gilbert Nathan ShedroffDiscussion
May 14, 2015
"We used the money earned from consulting other GE divisions to rebuild our studios and develop brand and design language principles."
Discussion
June 9, 2017
"By centering a global Black analysis, Afrofuturism not only problematizes notions of progress but also provides means to address systemic oppression."
Florence OkoyeAfroFuturism and UX Research
March 27, 2023
"We need to create an army of design thinkers across the organization who can make better decisions on what to build and how to build it."
Jemma AhmedTheme 2 Intro
January 8, 2024
"What really matters isn’t just how many experiments you run, but how many new features get delivered to customers."
Chris ChapoData Science and Design: A Tale of Two Tribes
May 13, 2015
"We’re not going to start from the top. We’re going to use headings and landmarks to quickly scan a webpage."
Sam ProulxDesigning For Screen Readers: Understanding the Mental Models and Techniques of Real Users
December 10, 2021
"The design team unknowingly implemented many effective learning philosophies that helped them improve faster."
Yoel SumitroActions and Reflections: Bridging the Skills Gap among Researchers
March 9, 2022
"Accessibility isn’t one size fits all — everybody has unique circumstances, needs, and preferences."
Sam ProulxUnderstanding Screen Readers on Mobile: How And Why to Learn from Native Users
October 2, 2023
"An intelligent person understands what is being said, a wise person understands what is left."
Iram ShahClosing Keynote: The View from the Top
June 4, 2019