Rosenverse
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration

Gold
Tuesday, March 11, 2025 • Advancing Research 2025

This video is featured in the PDI 2026 playlist.

Share the love for this talk
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
Speakers: Llewyn Paine
Link:

Summary

As culture and technology evolve, researchers must learn to co-exist with AI. Understanding its benefits, limitations, and ethical challenges is essential. This guide offers practical insights on top AI tools, advice on when and how to integrate AI into workflows, and a balanced view of the good, the bad and the ugly of the current AI landscape.

Key Insights

  • •

    AI is shifting the authoritative voice in research from humans to generative models, challenging researchers’ traditional value.

  • •

    Framing research value by sheer output risks commoditizing the field and losing long-term business impact.

  • •

    Measuring research impact through concrete business outcomes is harder but essential for sustaining researcher relevance.

  • •

    Research integrity is at risk if AI adoption isn't rigorously tested, as stakeholders expect researchers to model best practices.

  • •

    AI tools can introduce biases especially affecting marginalized groups, impacting fairness in user research.

  • •

    User researchers’ specialized skills in navigating complex trade-offs uniquely position them to integrate AI responsibly.

  • •

    The lack of standardized methods for using AI in social science research makes learning from engineers and scientists critical.

  • •

    Human data collection remains irreplaceable due to AI's weaknesses in understanding niche cultures and novel insights.

  • •

    AI enables researchers to extend beyond study execution into prototyping, impact tracing, and direct product decision influence.

  • •

    The rise of AI-powered 'triple threat' researchers combines research, product management, and design augmented by AI capabilities.

Notable Quotes

"Right now, there’s a fear of being replaced by AI, and while a lot of that’s overblown, researchers have a legitimate reason to feel uncomfortable."

"The choices we make about AI are about much more than speed versus quality — they define how we value research and our relationships."

"Volume is a losing game because we cannot outcompete full AI automation for sheer speed and quantity of insights."

"If we want our value to be defined as anything other than studies run, we must learn how to trace and articulate the actual business impact."

"If we are haphazard about AI adoption and trust marketers over rigorous testing, it looks like all our hand wringing about research accuracy was just gatekeeping."

"Generative AI is non-deterministic and doesn’t understand meaning, so baseline error rates exist in all tools we use."

"Prompting is a specialized skill, just like statistics or in-depth interviewing; the wrong wording can bias your results."

"More than a third of content on social media sites is AI generated, creating a training problem for new AI models."

"AI can empower researchers to solve pain points — like anticipating trends or critiquing discussion guides — amplifying impact rather than replacing work."

"We should think of AI as something that amplifies what we already are: if we think research is about impact, AI will help us understand and track it."

Ask the Rosenbot
Sarah Coyle
Design and Analytics with Sarah Coyle
2020 • DesignOps Community
Aras Bilgen
Who does the math: A designer’s journey in building an AI-based tutoring app
2025 • Designing with AI 2025
Gold
Noel Lamb
Cultivating Business Partnerships to Grow Research Ops
2022 • Advancing Research Community
Chris Hodowanec
Agile + User Experience: How to navigate the Agile landscape as an UX Practitioner
2022 • Civic Design 2022
Gold
Louis Rosenfeld
How AI will Change DesignOps Tooling
2023 • DesignOps Summit 2023
Gold
Sarah Sgarlato Pierini
From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn
2022 • DesignOps Summit 2022
Gold
Paul Pangaro, PhD
Systems Disciplines: Table Stakes for 21st Century Organizations
2023 • Enterprise UX 2023
Gold
Ariel Kennan
Theme 2 Intro
2021 • Civic Design 2021
Gold
Frank Duran
Partnership Playbook: Lessons Learned in Effective Partnership
2024 • Enterprise Experience 2020
Gold
Sean McKay
Whole Product Thinking: Expanding beyond problem and solution space thinking
2024 • Rosenfeld Community
Nova Wehman-Brown
We've Never Done This Before
2019 • Enterprise Experience 2019
Gold
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
Niko Laitinen
Adaptable Org Design for Resilient Times
2021 • Design at Scale 2021
Gold
Amy Marquez
INVEST: Discussion
2018 • Enterprise Experience 2018
Gold
Bria Alexander
Opening Remarks
2024 • Advancing Research 2021
Gold
Wendy Johansson
Design at Scale: Behind the Scenes
2021 • Enterprise Community

More Videos

Yalenka Mariën

"Working towards cross-platform coherence is crucial so people can have similar reference points wherever they are."

Yalenka Mariën Marie Mervaillie

Designing for Digital Inclusion in the Belgian Government

December 8, 2021

Megan Nipe

"Nearly three quarters of those surviving violent trauma report alcohol use disorders, which can lead to thoughts of suicide."

Megan Nipe Lyndsay Booth

Human-Centered Design for Engagement: Maturing from Newsletterville to Personalized, One-to-One Messaging

December 8, 2021

Dr. Jamika D. Burge

"Being radically honest about who is in the research helps avoid sweeping generalizations that exclude marginalized groups."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices

September 15, 2022

Jemma Ahmed

"I’d love to see the death of the discussion guide and the six-person qual study."

Jemma Ahmed Robert Fabricant Sean McKay Llewyn Paine Kate Towsey Noah Bond

Theme Panel

March 11, 2025

Louis Rosenfeld

"Our conference recordings include decks, notes, transcripts, reading lists, and more."

Louis Rosenfeld

About the Rosenverse

March 15, 2026

Nalini P. Kotamraju

"Leadership is a mode, not a title, and anyone can be a leader."

Nalini P. Kotamraju

Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"

March 10, 2021

Sarah Barrett

"An everything chat bot is almost certainly not how you’re going to build it; realistically you’re building three apps in a trench coat."

Sarah Barrett

AI in Real Life: Using LLMs to Turbocharge Microsoft Learn

February 13, 2025

Jane Davis

"The hardest part of any researcher's job is translating insights into action."

Jane Davis

Strategic Shifts and Innovations in User Research: Navigating Challenges and Opportunities

March 11, 2025

Alba Villamil

"Latino parents framed classrooms as the teacher’s domain and home as theirs, avoiding engagement to respect authority."

Alba Villamil

Stereotyped by Design: Pitfalls in Cross-Cultural User Research

March 30, 2020