Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]

Thursday, August 31, 2023 • Advancing Research Community
Share the love for this talk
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]
Speakers: Dr. Jamika D. Burge , Nick Fine , Alexandra Jayeun Lee , Greg Nudelman and Bo Wang
Link:

Summary

Four of your research colleagues discussed and defended their respective positions (below) on the impact of AI on user research. Participants engaged in a discussion and Q&A, facilitated by Dr. Jamika D. Burge. “AI has the potential to be the researcher's best friend, by doing all the heavy lifting associated with analysis - but it also has the potential to cause unimaginable damage”. – Nick Fine “Researchers absolutely must learn to create AI prompts. Not only will prompt engineering become an essential, required research skill, but it will also offer a much-needed opportunity to rethink our role as facilitators of change.” – Alexandra Jayeun Lee Soon, AI will be able to utilize the participant's feedback as a prompt to create RITE design variations on the fly, offering the researcher multiple flow options organically and in real time, which will radically transform our research practice.” – Greg Nudelman “UX Researchers can reinvent themselves as “delightful ethicists” who oversee ethics on critical issues when generative AI supplies abundant solutions without providing the why." – Bo Wang

Key Insights

  • AI poses both great risks and opportunities for UX research, with validity and bias being central concerns.

  • Inexperienced researchers relying on AI outputs without critical judgment risk spreading inaccurate insights.

  • Prompt engineering is emerging as a fundamental skill for UX researchers, similar to how coding became essential for designers.

  • AI can automate repetitive design tasks and rapid prototyping, enabling faster iteration and freeing researchers for higher-level strategy.

  • Moderated usability testing will not be fully replaced by AI due to the irreplaceable nature of human empathy and adaptive interaction.

  • UX researchers should evolve into 'delightful ethicists' leading ethical AI practices and guarding against 'dark AI' and synthetic users.

  • Ethics in AI extends beyond moral principles to everyday product decisions and protecting users from harm.

  • Bias is inherent in AI training data and tools; researchers must call out, understand, and address such bias explicitly.

  • Demonstrating tangible business value by linking user research to outcomes remains essential for maintaining researcher relevance.

  • Collective learning across disciplines and broadening AI literacy within the research community is critical to navigate AI’s impact.

Notable Quotes

"AI has as much capacity to do as much harm as it does good."

"It takes an experienced researcher to be able to wrangle AI prompts to have any chance of getting good work."

"Learning prompt engineering will make us better researchers in the same way coding helped designers."

"The best large language model is right under your nose: the human brain with 300,000 years of ancestral development."

"AI gives us superpowers to do rapid iterative testing and evaluation much faster than before."

"We should reinvent UX researchers to be delightful ethicists leading ethical concerns in AI adoption."

"AI cannot do empathy; moderated usability testing requires the human ability to pivot and connect."

"AI is biased by design; assume bias is in there, call it out, and then address it."

"User research's value lies in linking user needs and pain points directly to business profit and loss."

"If we don’t advocate for understanding AI, more decisions will be made without researchers, leading to unjust outcomes."

Ask the Rosenbot
Adam Thomas
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
2022 • Design in Product 2022
Gold
Adam Cutler
Discussion
2016 • Enterprise UX 2016
Gold
Courtney Kaplan
Taking it to the next level: Career paths in DesignOps
2018 • DesignOps Summit 2018
Gold
Dr. Jamika D. Burge
Broad Strokes: Connecting Design, Research, and AI to the World Around Us
2023 • Enterprise UX 2023
Gold
Ian Swinson
Designing and Driving UX Careers
2016 • Enterprise UX 2016
Gold
Steve Portigal
Discussion
2015 • Enterprise UX 2015
Gold
Shelby Switzer
Making Space for Community Knowledge-sharing in a Distributed World
2021 • Civic Design 2021
Gold
Teresa Swingler
Look, Up in the Sky! UX/UI for Aerospace
2022 • Enterprise Community
Daniel J. Rosenberg
Designing with and for Artificial Intelligence
2022 • Enterprise Community
Mike Oren
Why Pharmaceutical's Research Model Should Replace Design Thinking
2023 • Advancing Research 2023
Gold
Janelle Estes
UX Research Trends
2021 • Advancing Research Community
Joseph Meersman
Sweating the Pixel: Scaling Quality through Critique
2021 • Design at Scale 2021
Gold
Alla Weinberg
Workers Are Sick of Change: The Cure is Psychological Safety
2023 • Enterprise UX 2023
Gold
Melissa Tsang
From Insights to Action: Driving Business Values through DesignOps
2024 • DesignOps Summit 2020
Gold
How to Identify and Increase your "Experience Quotient"
2018 • Enterprise Experience 2018
Gold
Chelsea Mauldin
Let's Talk About Money
2022 • Civic Design 2022
Gold

More Videos

Xenia Adjoubei

"The Researcher in Residence program invites members of affected communities to use our tools over a funded three-month period pro bono."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

Tamara Kartoziia

"Our framework is our playbook, our single source of truth for every launch."

Tamara Kartoziia

Think global, adapt local: how service design accelerated B2B market entry by 6 months

November 20, 2025

Jay Bustamante

"Ethical stress testing subjects AI to hypothetical morally challenging scenarios to ensure alignment with ethical norms."

Jay Bustamante

Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation

October 2, 2023

Nicole Aleong

"Anticipation involves preparatory actions to manage uncertainty about future conditions."

Nicole Aleong

Future Orientations to Everyday Life: Futures Anthropology as a Methodology

March 26, 2024

Nick Lewis

"Creative constraints can actually bring out the most creative solutions."

Nick Lewis

Designing and building low-carbon websites independently

November 18, 2025

Vicky Teinaki

"UX practitioners already have the mindset and mentality needed to drive a product discussion forward and a handy toolkit of approaches and methods."

Vicky Teinaki Michele Marut Tim Parmee

Short Take #3: UX/Product Lessons from Your Industry Peers

December 6, 2022

Laura Weiss

"The ultimate goal in conflict is to engage with the tension while reducing the friction between humans."

Laura Weiss

Turn Down the Heat: 3 Ways to Handle Conflict in the Moment

November 20, 2024

Joerg Beringer

"We model context of use as knowledge graphs with tasks, sub-task goals, task objects—all linked in relations."

Joerg Beringer Thomas Geis

Scaling User Research with AI: Continuous Discovery of User Needs in Minutes

June 10, 2025

Shelby Switzer

"Facilitation is part setting the stage and part performing on it."

Shelby Switzer

Making Space for Community Knowledge-sharing in a Distributed World

December 10, 2021