Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Wednesday, September 4, 2024 • Advancing Research Community
Share the love for this talk
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Speakers: Sam Ladner , Megan Blocker , Tanvi Dhond , Katie Hansen and Ricardo Martins
Link:

Summary

Researchers are being asked to help address challenges that are increasingly complex, strategic, and high-stakes. Our toolkit of methods needs to keep up with those challenges, as does our confidence and comfort with choosing, using, and combining those methods. Our Methods panelists will describe some of the exciting techniques they’re applying in their work, and discuss how they’ve overcome barriers to enriching their UXR toolkits. Attend all of our Advancing Research community workshops Each free virtual workshop is made up of panelists who will share short provocations on engaging ideas to discuss as a group, as well as a leader in our field to moderate. If you're looking for discussions that challenge the status quo and can truly advance research, look no further than our workshop series. (P.S. We’ll be drawing most of our Advancing Research 2025 conference speakers from those who present at upcoming workshops—so tune in for a sneak peek of what's to come from #AR2025!) July 24, 4-5pm EDT Watch Video Theme 1: Democratization Working with it, not against August 7, 11am-12pm EDT Watch Video Theme 2: Collaboration Learning from market research, data science, customer experience, and more August 21, 4-5pm EDT Watch Video Theme 3: Communication Innovative techniques for making your voice heard September 18, 4-5pm EDT Watch Video Theme 5: Artificial Intelligence Passionate defenses, reasoned critiques, and practical application October 2, 11am-12pm EDT Watch Video Theme 6: Junctures for UXR Possible futures and the critical decisions to move us forward October 16, 4-5pm EDT Watch Video Theme 7: Open Call Propose ideas that don’t match our other workshops’ themes

Key Insights

  • Mixed methods research—combining qualitative and quantitative approaches—deepens understanding beyond what interviews alone can offer.

  • Participant comfort and rapport are crucial to mitigating unconscious bias and eliciting authentic responses in any research method.

  • Quantitative techniques like conjoint analysis reveal statistically significant trade-offs and patterns that interviews cannot reliably capture.

  • Observational methods such as contextual inquiry expose workarounds and behaviors users may be unaware of or unable to articulate.

  • Stakeholder buy-in requires pragmatism and clear alignment of methods to research questions and participants’ needs.

  • Researchers often lean on interviews as a 'crutch' despite better-suited alternatives existing for certain questions.

  • Shadowing and learning from colleagues across disciplines, including data analysts and scientists, enriches research skills.

  • Community-based participatory research expands inclusivity and leverages insider knowledge to reach marginalized groups sensitively.

  • Interview questions must derive from research questions creatively rather than directly asking for attitudes or solutions.

  • The role and responsibility of the researcher includes managing participant burden, bias, and ensuring data validity based on impact level.

Notable Quotes

"User interviews are an absolute mainstay but it's important to be aware of the breadth of available methods."

"Some people lie, so mixing methods helps triangulate reality beyond what anyone says."

"Interviews are incredible for exploring unknown spaces but watching people at work reveals unseen opportunities."

"Setting participants at ease is essential to get to some of the truth."

"People are not there for us to extract from; they're often genuinely trying to help even if they don’t have all the answers."

"You don’t need to be an expert in every methodology but should know when to use them and find experts when needed."

"Community-based organizations can help researchers access deep contextual knowledge that outsiders would never have."

"Interviews alone are not a matter of angel or devil—they are useful if used responsibly and creatively."

"The biggest mistake beginners make is confusing research questions with direct interview questions."

"If interviews didn’t exist, our richness of insights would remain strong by pivoting to alternative research methods."

Ask the Rosenbot
Laura Weiss
Turn Down the Heat: 3 Ways to Handle Conflict in the Moment
2024 • Rosenfeld Community
Holly Cole
Understanding Experiences: When you have to do more than work
2018 • DesignOps Summit 2018
Gold
Mariah Hay
BUILD: Discussion
2018 • Enterprise Experience 2018
Gold
Charlotte Lee
Theme 1 Intro
2021 • Civic Design 2021
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Angelos Arnis
State of DesignOps: Learnings from the 2021 Global Report
2021 • DesignOps Summit 2021
Gold
Tracy McGoldrick
IBM User Experience Program—The What, Why and How (Videoconference)
2021 • Advancing Research Community
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
Victor Udoewa
Beyond Methods and Diversity: The Roots of Inclusion
2024 • Advancing Research 2024
Gold
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group (Rosenfeld Community)
Jon Fukuda
Design Planning and Management Support
2023 • DesignOps Summit 2023
Gold
Dave Hora
A Research Skills Evolution
2021 • Advancing Research 2021
Gold
World Usability Day Panel Discussion (Videoconference)
2022 • DesignOps Community
Alla Weinberg
Healing Toxic Stress
2024 • DesignOps 2024
Gold
Sarah Auslander
Incremental Steps to Drive Radical Innovation in Policy Design
2022 • Civic Design 2022
Gold
Courtney Maya George
Scale Your Organization and Grow Your Designers
2022 • DesignOps Summit 2022
Gold

More Videos

Indi Young

"We use mental model skylines to see gaps and opportunities in how we support different thinking styles."

Indi Young

Thinking styles: Mend hidden cracks in your market

January 8, 2025

Andrew Webster

"Everyone should borrow from some essential design tools and sensibilities to do their work better, even if they aren’t designers."

Andrew Webster

Scaling Design Capability: How Involved Should You Be?

September 30, 2021

Bria Alexander

"Sponsor sessions are not sales pitches; they’re super similar to the quality of the main conference session."

Bria Alexander

Opening Remarks

October 1, 2021

Cheryl Platz

"One of the golden rules is leave shame at the door because improv often means reconnecting with your kindergarten self."

Cheryl Platz

Merging Improv with Design (Videoconference)

March 7, 2019

Jennifer Kong

"The plot twist was that AI was causing new problems impacting performance, morale, and satisfaction, showing people are the real key."

Jennifer Kong

[Case study] Journeying toward AI-assisted documentation in healthcare

June 5, 2024

Sahibzada Mayed

"Do I have a right to engage in this work or do I feel entitled to it? Often it’s both."

Sahibzada Mayed

The Politics of Radical Research: A Manifesto

March 27, 2023

Rebecca Gimenez

"Our mission to build belonging and trust inspires me every day. Service design helps create space to zoom out and have critical vision conversations."

Rebecca Gimenez

Work in Progress: Service Design at Airbnb

December 3, 2024

Ruzanna Rozman

"There’s a science and a sense of instinct, like athletes developing their moves as they practice."

Ruzanna Rozman

Getting in Flow with Your Team

January 8, 2024

Chris Geison

"What are you willing to say no to? That’s the heart of having a research strategy."

Chris Geison

What is Research Strategy?

March 11, 2021