Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Harnessing AI in UXR: Practical Strategies for Positive Impact
Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Harnessing AI in UXR: Practical Strategies for Positive Impact
Speakers: Savina Hawkins
Link:

Summary

Join Savina Hawkins as she presents a focused exploration of large language models in User Experience Research (UXR). This talk zeroes in on practical, actionable strategies for leveraging these advanced AI tools to enhance UXR outcomes. Savina will discuss the dual nature of large language models, illuminating their potential to both revolutionize and challenge UXR practices. Attendees will learn to identify and mitigate risks while maximizing the benefits of these models in real-world scenarios. The session promises a clear, concise roadmap for UX researchers to effectively integrate large language models into their workflow, ensuring positive, impactful results.

Key Insights

  • Prompt engineering is emerging as the fifth essential tool for researchers alongside traditional UXR methods.

  • Large language models learn language and reasoning skills solely from statistical relationships in massive text data, not human-like understanding.

  • GPT’s transformer architecture acts like advanced kitchen technology enabling fast, focused processing of text inputs and outputs.

  • Prompt chaining, especially multi-threaded types, allows complex workflows where output from one AI prompt feeds the next, enabling rigorous analysis.

  • The art of prompt design parallels crafting research interview guides, utilizing wording, order, context, and priming carefully.

  • Current AI, including GPT, can produce convincing but sometimes false or biased outputs, highlighting the risks of blind trust or magic eight ball thinking.

  • Future AI advancements aim to achieve artificial general intelligence (AGI), combining learning from experience, problem solving, and contextual understanding.

  • Humanistic researchers are uniquely suited to shape ethical AI design through their expertise in mental models, values, and historical context.

  • AI-driven transformations will disrupt traditional workflows, power structures, and redefine white-collar roles, demanding dialogue on shared human-technology futures.

  • Despite fears of automation, AI tools can democratize access to high-level knowledge work skills, but require critical human interpretation to avoid misuse.

Notable Quotes

"I’m willing to bet that every researcher in this room by the end of 2025 will add prompt engineering to their research skillset."

"GPT is like a master chef who’s traveled the world sampling and learning from every cuisine imaginable."

"Large language models learn spelling, grammar, how to engage in dialogue, how to write many languages, even code, and even how to argue, persuade, and deceive."

"The secret sauce behind GPT’s abilities is the transformer architecture, the latest in kitchen technology that allows the chef to work really fast and efficiently."

"Prompt chaining is one of the most underrated techniques in prompt engineering, turning chains of prompts into designed information processing workflows."

"Prompting at its core involves very specifically using the inputs you give the technology so you can elicit desired outputs."

"The art of prompt design shares a strong connection with the art of conducting interviews and creating discussion guides."

"AI tools can do the entire process of qualitative analysis at the click of a button."

"When humans blindly prompt a large language model, they’re not receiving wisdom from an all-knowing oracle but probabilistic outcomes based on patterns."

"Our roles will evolve into beings that imbue meaning into processed information while AI industrializes content creation."

Ask the Rosenbot
Candace Myers
Standardizing Design at Scale
2022 • DesignOps Summit 2022
Gold
Kyria Stephens
Power to Heal: Civic Design in the Aftermath of Tragedy
2022 • Civic Design 2022
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Jackie Velasquez-Ross
Talent Acquisition and Our Responsibility (Videoconference)
2020 • DesignOps Community
Nalini P. Kotamraju
Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
2021 • Advancing Research 2021
Gold
Matt LeMay
You Don’t “Get” Anyone to Do Anything
2022 • Design in Product 2022
Gold
Surya Vanka
Unleashing Swarm Creativity to Solve Enterprise Challenges
2021 • Design at Scale 2021
Gold
Sarah Kinkade
Design Management Models in the Face of Transformation
2022 • Design at Scale 2022
Gold
Operationalizing DesignOps
2018 • DesignOps Summit 2018
Gold
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Noreen Whysel
Short Take #4: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
DesignOps Community Sensing Session (Videoconference)
2021 • DesignOps Community
Francesca Barrientos, PhD
You Need Your Own Definition of Design Maturity
2022 • Design at Scale 2022
Gold
Alla Weinberg
Workers Are Sick of Change: The Cure is Psychological Safety
2023 • Enterprise UX 2023
Gold
Tatyana Mamut
Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart
2019 • Enterprise Experience 2019
Gold
Josh Clark
Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
2025 • Rosenfeld Community

More Videos

Adam Cutler

"A good story that people can retell is key for global communication, even if it distorts a bit."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"UXers are less satisfied than their peers because we have failed to set expectations about the real work of UX in organizations."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"Nobody knows who’s supposed to decide what around digital, and that’s the problem."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"The time for action is now, and it must be collaborative."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"OKRs are a tool for each of us to tidy our house and focus on what’s important."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"Thick data is the opposite of big data; it’s stories, qualitative, and crucial during moments of rapid change."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"Creating hypotheses from pain points with measurable success criteria helped prioritize which to pursue."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"With proper maintenance, knowledge becomes a vehicle that probes the most hidden spaces of possibility and brings the best decisions to the surface."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"Randomization is magic — it evenly distributes confounds so the only difference affecting results is your change."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024