Rosenverse
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration

Gold
Tuesday, March 11, 2025 • Advancing Research 2025

This video is featured in the PDI 2026 playlist.

Share the love for this talk
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
Speakers: Llewyn Paine
Link:

Summary

As culture and technology evolve, researchers must learn to co-exist with AI. Understanding its benefits, limitations, and ethical challenges is essential. This guide offers practical insights on top AI tools, advice on when and how to integrate AI into workflows, and a balanced view of the good, the bad and the ugly of the current AI landscape.

Key Insights

  • •

    AI is shifting the authoritative voice in research from humans to generative models, challenging researchers’ traditional value.

  • •

    Framing research value by sheer output risks commoditizing the field and losing long-term business impact.

  • •

    Measuring research impact through concrete business outcomes is harder but essential for sustaining researcher relevance.

  • •

    Research integrity is at risk if AI adoption isn't rigorously tested, as stakeholders expect researchers to model best practices.

  • •

    AI tools can introduce biases especially affecting marginalized groups, impacting fairness in user research.

  • •

    User researchers’ specialized skills in navigating complex trade-offs uniquely position them to integrate AI responsibly.

  • •

    The lack of standardized methods for using AI in social science research makes learning from engineers and scientists critical.

  • •

    Human data collection remains irreplaceable due to AI's weaknesses in understanding niche cultures and novel insights.

  • •

    AI enables researchers to extend beyond study execution into prototyping, impact tracing, and direct product decision influence.

  • •

    The rise of AI-powered 'triple threat' researchers combines research, product management, and design augmented by AI capabilities.

Notable Quotes

"Right now, there’s a fear of being replaced by AI, and while a lot of that’s overblown, researchers have a legitimate reason to feel uncomfortable."

"The choices we make about AI are about much more than speed versus quality — they define how we value research and our relationships."

"Volume is a losing game because we cannot outcompete full AI automation for sheer speed and quantity of insights."

"If we want our value to be defined as anything other than studies run, we must learn how to trace and articulate the actual business impact."

"If we are haphazard about AI adoption and trust marketers over rigorous testing, it looks like all our hand wringing about research accuracy was just gatekeeping."

"Generative AI is non-deterministic and doesn’t understand meaning, so baseline error rates exist in all tools we use."

"Prompting is a specialized skill, just like statistics or in-depth interviewing; the wrong wording can bias your results."

"More than a third of content on social media sites is AI generated, creating a training problem for new AI models."

"AI can empower researchers to solve pain points — like anticipating trends or critiquing discussion guides — amplifying impact rather than replacing work."

"We should think of AI as something that amplifies what we already are: if we think research is about impact, AI will help us understand and track it."

Ask the Rosenbot
Sheryl Cababa
Living in the Clouds: Adopting a Systems Thinking Mindset
2023 • Enterprise UX 2023
Gold
Natalie Dunbar
DesignOps and Content Strategy: Envisioning the Future Together
2021 • DesignOps Summit 2021
Gold
Steve Portigal
War Stories LIVE! Q&A-Discussion
2020 • Advancing Research 2020
Gold
Michaela Mora
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
2022 • Advancing Research 2022
Gold
Anna Avrekh
User Research, Design, and Product - A Love Story
2021 • Advancing Research 2021
Gold
Gregg Bernstein
Opportunistic Research with Gregg Bernstein
2019 • Advancing Research Community
Liwei Dai
The Heart and Brain of the AI Research
2020 • Advancing Research 2020
Gold
Amy Evans
How to Create Change
2024 • DesignOps Summit 2024
Gold
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold
Lori Muszynski
Keeping Design Weird
2023 • DesignOps Summit 2023
Gold
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Yasmine Khan
Checking Bias and Listening to Financially Vulnerable Americans
2020 • Advancing Research 2020
Gold
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Dave Malouf
The Future of DesignOps
2024 • DesignOps Summit 2020
Gold
Catt Small
Moving from Execution to Strategy as a Designer
2022 • Design in Product 2022
Gold

More Videos

Simon Wardley

"If I don’t have a map, I can’t see the landscape, I can’t see the patterns impacting it, and I’m left only with purpose and blind action."

Simon Wardley

Maps and Topographical Intelligence

January 31, 2019

Megan Blocker

"I want you to push yourselves to try one new approach, to challenge one of your assumptions, and to walk away ready to take an action."

Megan Blocker

Theme 2 Intro

March 12, 2025

Mila Kuznetsova

"Make sure children understand they can stop the session at any time, and confirm they really get that."

Mila Kuznetsova Lucy Denton

How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices

March 9, 2022

Megan Blocker

"The longer I’m in UX, the less I think I know—there’s always more to learn and ways to develop."

Megan Blocker Lada Gorlenko Fatimah Richmond Molly Stevens

What UX research maturity looks like and how we get there [Advancing Research Community Workshop Series]

November 9, 2023

Wendy Johansson

"You can be a small company providing solutions for thousands of users or large companies—it’s about scale in different dimensions."

Wendy Johansson Surya Vanka

Design at Scale: Behind the Scenes

April 29, 2021

David Sternberg

"Human behavior is anything but linear, rational, or predictable."

David Sternberg

Uncovering the hidden forces shaping user behavior

July 17, 2025

Sam Proulx

"A lot of accessibility work isn’t just for a small group — designing for the edges gets you the middle for free, as Yuda Trevor says."

Sam Proulx

Online Shopping: Designing an Accessible Experience

November 29, 2023

John Cutler

"Maturity is not linear; the tanker company had a lot to learn from the speedboat, and vice versa."

John Cutler

Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)

December 3, 2024

Jayne Engle

"We need to hospice and compost broken systems to transition toward regenerative, people-driven urban futures."

Jayne Engle Tanya Chung-Tiam-Fook

Civic Design for the Next Seven Generations—A Discussion on Sacred Civics

August 25, 2022