Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Harnessing AI in UXR: Practical Strategies for Positive Impact
Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Harnessing AI in UXR: Practical Strategies for Positive Impact
Speakers: Savina Hawkins
Link:

Summary

Join Savina Hawkins as she presents a focused exploration of large language models in User Experience Research (UXR). This talk zeroes in on practical, actionable strategies for leveraging these advanced AI tools to enhance UXR outcomes. Savina will discuss the dual nature of large language models, illuminating their potential to both revolutionize and challenge UXR practices. Attendees will learn to identify and mitigate risks while maximizing the benefits of these models in real-world scenarios. The session promises a clear, concise roadmap for UX researchers to effectively integrate large language models into their workflow, ensuring positive, impactful results.

Key Insights

  • Prompt engineering is emerging as the fifth essential tool for researchers alongside traditional UXR methods.

  • Large language models learn language and reasoning skills solely from statistical relationships in massive text data, not human-like understanding.

  • GPT’s transformer architecture acts like advanced kitchen technology enabling fast, focused processing of text inputs and outputs.

  • Prompt chaining, especially multi-threaded types, allows complex workflows where output from one AI prompt feeds the next, enabling rigorous analysis.

  • The art of prompt design parallels crafting research interview guides, utilizing wording, order, context, and priming carefully.

  • Current AI, including GPT, can produce convincing but sometimes false or biased outputs, highlighting the risks of blind trust or magic eight ball thinking.

  • Future AI advancements aim to achieve artificial general intelligence (AGI), combining learning from experience, problem solving, and contextual understanding.

  • Humanistic researchers are uniquely suited to shape ethical AI design through their expertise in mental models, values, and historical context.

  • AI-driven transformations will disrupt traditional workflows, power structures, and redefine white-collar roles, demanding dialogue on shared human-technology futures.

  • Despite fears of automation, AI tools can democratize access to high-level knowledge work skills, but require critical human interpretation to avoid misuse.

Notable Quotes

"I’m willing to bet that every researcher in this room by the end of 2025 will add prompt engineering to their research skillset."

"GPT is like a master chef who’s traveled the world sampling and learning from every cuisine imaginable."

"Large language models learn spelling, grammar, how to engage in dialogue, how to write many languages, even code, and even how to argue, persuade, and deceive."

"The secret sauce behind GPT’s abilities is the transformer architecture, the latest in kitchen technology that allows the chef to work really fast and efficiently."

"Prompt chaining is one of the most underrated techniques in prompt engineering, turning chains of prompts into designed information processing workflows."

"Prompting at its core involves very specifically using the inputs you give the technology so you can elicit desired outputs."

"The art of prompt design shares a strong connection with the art of conducting interviews and creating discussion guides."

"AI tools can do the entire process of qualitative analysis at the click of a button."

"When humans blindly prompt a large language model, they’re not receiving wisdom from an all-knowing oracle but probabilistic outcomes based on patterns."

"Our roles will evolve into beings that imbue meaning into processed information while AI industrializes content creation."

Ask the Rosenbot
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Uday Gajendar
Day 1 Welcome
2024 • Designing with AI 2024
Gold
Veevi Rosenstein
Building for Scale: Creating the Zendesk UX Research Practice
2024 • Enterprise Experience 2020
Gold
Farid Sabitov
Automatization for Large Enterprise Teams
2024 • DesignOps Summit 2020
Gold
Alla Weinberg
Design Teams Need Psychological Safety: Here’s How to Create It
2022 • DesignOps Summit 2022
Gold
Abby Covert
Panel: Collaboration Tools
2017 • DesignOps Summit 2017
Gold
Angelos Arnis
State of DesignOps: Learnings from the 2021 Global Report
2021 • DesignOps Summit 2021
Gold
Chris Chapo
Data Science and Design: A Tale of Two Tribes
2015 • Enterprise UX 2015
Gold
Dem Gerolemou
Climate technology fundamentals (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Etienne Fang
The Power of Care: From Human-Centered Research to Humanity-Centered Leadership
2021 • Advancing Research 2021
Gold
Uday Gajendar
From AI to Zeitgeist: Theory as the design antidote to AI hype
2025 • Rosenfeld Community
Alberto Ferreira
Making it Count: Developing a custom digital metric framework that works
2021 • QuantQual Interest Group (Rosenfeld Community)
Mackenzie Cockram
Integrating Qualitative and Quantitative Research from Discovery to Live
2022 • QuantQual Interest Group (Rosenfeld Community)
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Stop Talking, Start Doing
2017 • Enterprise Experience 2017
Gold
Alla Weinberg
How to Build and Scale Team Safety
2024 • DesignOps Summit 2020
Gold

More Videos

Jennifer Kanyamibwa

"If you really want to build culture and see how people cross collaborate, try to make lunch with your entire team every single week."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Brigette Metzler

"In large organizations, research teams usually pay for the repo but the value is delivered across the whole company."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community (Videoconference)

August 27, 2020

Carl Turner

"Taking meeting minutes and assigning action items with director names reduced arguing and helped move things forward."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

John Mortimer

"Gina was closing the dots and shifting perspective from a designer closer to the business."

John Mortimer Milan Guenther Lucy Ellis Patrick Quattlebaum

Panel Discussion

December 3, 2024

Dante Guintu

"Extended radio silence to candidates was unnerving and one of the unpleasant truths we heard from teammates."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Richard Buchanan

"The new marketing is about preparing users or customers for the new kinds of products that will emerge as time moves forward."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Dan Willis

"Every speaker before me had these pristine backgrounds. I’m a slob and feeling really self-conscious about it."

Dan Willis

Theme 3: Intro

January 8, 2024

Dan Ward

"We do experiments to learn, and if we learn something, then it’s a successful experiment."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Chris Geison

"This is a weird time for research. Layoffs have torn through our field. I've been laid off too."

Chris Geison

Theme Two Intro

March 28, 2023