Summary
Join Savina Hawkins as she presents a focused exploration of large language models in User Experience Research (UXR). This talk zeroes in on practical, actionable strategies for leveraging these advanced AI tools to enhance UXR outcomes. Savina will discuss the dual nature of large language models, illuminating their potential to both revolutionize and challenge UXR practices. Attendees will learn to identify and mitigate risks while maximizing the benefits of these models in real-world scenarios. The session promises a clear, concise roadmap for UX researchers to effectively integrate large language models into their workflow, ensuring positive, impactful results.
Key Insights
-
•
Prompt engineering is emerging as the fifth essential tool for researchers alongside traditional UXR methods.
-
•
Large language models learn language and reasoning skills solely from statistical relationships in massive text data, not human-like understanding.
-
•
GPT’s transformer architecture acts like advanced kitchen technology enabling fast, focused processing of text inputs and outputs.
-
•
Prompt chaining, especially multi-threaded types, allows complex workflows where output from one AI prompt feeds the next, enabling rigorous analysis.
-
•
The art of prompt design parallels crafting research interview guides, utilizing wording, order, context, and priming carefully.
-
•
Current AI, including GPT, can produce convincing but sometimes false or biased outputs, highlighting the risks of blind trust or magic eight ball thinking.
-
•
Future AI advancements aim to achieve artificial general intelligence (AGI), combining learning from experience, problem solving, and contextual understanding.
-
•
Humanistic researchers are uniquely suited to shape ethical AI design through their expertise in mental models, values, and historical context.
-
•
AI-driven transformations will disrupt traditional workflows, power structures, and redefine white-collar roles, demanding dialogue on shared human-technology futures.
-
•
Despite fears of automation, AI tools can democratize access to high-level knowledge work skills, but require critical human interpretation to avoid misuse.
Notable Quotes
"I’m willing to bet that every researcher in this room by the end of 2025 will add prompt engineering to their research skillset."
"GPT is like a master chef who’s traveled the world sampling and learning from every cuisine imaginable."
"Large language models learn spelling, grammar, how to engage in dialogue, how to write many languages, even code, and even how to argue, persuade, and deceive."
"The secret sauce behind GPT’s abilities is the transformer architecture, the latest in kitchen technology that allows the chef to work really fast and efficiently."
"Prompt chaining is one of the most underrated techniques in prompt engineering, turning chains of prompts into designed information processing workflows."
"Prompting at its core involves very specifically using the inputs you give the technology so you can elicit desired outputs."
"The art of prompt design shares a strong connection with the art of conducting interviews and creating discussion guides."
"AI tools can do the entire process of qualitative analysis at the click of a button."
"When humans blindly prompt a large language model, they’re not receiving wisdom from an all-knowing oracle but probabilistic outcomes based on patterns."
"Our roles will evolve into beings that imbue meaning into processed information while AI industrializes content creation."
Dig deeper—ask the Rosenbot:
More Videos
"We did all these analyses for each market and then fit the group to be proportional to key hosting and traveling characteristics."
Wyatt HaymanGlobal Research Panels (Videoconference)
August 8, 2020
"Naming things is the hardest thing; it’s an ongoing process involving components, their parts, and properties."
PJ Buddhari Nate BaldwinMeet Spectrum, Adobe’s Design System
June 9, 2021
"Sacramento’s Civic Enrichment Center is an artifact aligning a city around community and future workforce needs."
Sarah GallimoreInspire Progress with Artifacts from the Future
November 18, 2022
"Many product managers got their roles because they know the business or subject matter, but they don’t know how to manage product development."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"Time poverty is a huge problem for women, especially those from marginalized backgrounds, and researchers must ask how much time they can give."
Dr. Jamika D. Burge Mansi GuptaAdvancing the Inclusion of Womxn in Research Practices (Videoconference)
September 15, 2022
"Product principles are minimal but help us say, oh, this is meeting that or not meeting that."
Amy MarquezINVEST: Discussion
June 15, 2018
"Telemetry is like sex in high school — everyone claims to do it, but most are doing it poorly."
Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl PlatzBeyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)
May 17, 2024
"A kickback is a free flowing and life giving gathering that transforms and electrifies throughout the night."
Zariah CameronReDesigning Wellbeing for Equitable Care in the Workplace
September 23, 2024
"Regular positive feedback, not just negative, is essential because many with ADHD rely on extrinsic motivation."
Jessica NorrisADHD: A DesignOps Superpower
September 9, 2022
