Rosenverse
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Methodologies: Beyond the interview [Advancing Research Community Workshop Series]

Wednesday, September 4, 2024 • Advancing Research Community
Share the love for this talk
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Speakers: Sam Ladner , Megan Blocker , Tanvi Dhond , Katie Hansen and Ricardo Martins
Link:

Summary

Researchers are being asked to help address challenges that are increasingly complex, strategic, and high-stakes. Our toolkit of methods needs to keep up with those challenges, as does our confidence and comfort with choosing, using, and combining those methods. Our Methods panelists will describe some of the exciting techniques they’re applying in their work, and discuss how they’ve overcome barriers to enriching their UXR toolkits. Attend all of our Advancing Research community workshops Each free virtual workshop is made up of panelists who will share short provocations on engaging ideas to discuss as a group, as well as a leader in our field to moderate. If you're looking for discussions that challenge the status quo and can truly advance research, look no further than our workshop series. (P.S. We’ll be drawing most of our Advancing Research 2025 conference speakers from those who present at upcoming workshops—so tune in for a sneak peek of what's to come from #AR2025!) July 24, 4-5pm EDT Watch Video Theme 1: Democratization Working with it, not against August 7, 11am-12pm EDT Watch Video Theme 2: Collaboration Learning from market research, data science, customer experience, and more August 21, 4-5pm EDT Watch Video Theme 3: Communication Innovative techniques for making your voice heard September 18, 4-5pm EDT Watch Video Theme 5: Artificial Intelligence Passionate defenses, reasoned critiques, and practical application October 2, 11am-12pm EDT Watch Video Theme 6: Junctures for UXR Possible futures and the critical decisions to move us forward October 16, 4-5pm EDT Watch Video Theme 7: Open Call Propose ideas that don’t match our other workshops’ themes

Key Insights

  • Interviews remain central but should be complemented with other methods for richer insights.

  • Quantitative techniques like conjoint analysis reveal patterns that interviews alone may miss.

  • Transitioning from structured experiments to interviews often feels uncomfortable but offers new exploration modes.

  • Observational methods such as contextual inquiry uncover users' tacit behaviors and workarounds.

  • Participant comfort and rapport especially matter when dealing with sensitive or high-stakes topics.

  • Mixed methods research benefits from collaboration across different roles, including data analysts and community organizations.

  • Researchers should be pragmatic about time and resources and pick methods fit for purpose and confidence needs.

  • Interviews are often misused as an easy default instead of creatively finding better alternatives.

  • Decentering the researcher and involving community partners leads to more inclusive and authentic data.

  • Researchers must check their own unconscious biases to avoid misinterpreting participant responses.

Notable Quotes

"User interviews are an absolute mainstay of user research practices and likely will always be a core tool."

"Some people lie; that’s why we need to triangulate methods to approach reality."

"Interviews can be a crutch that keeps us from using better ways to answer our questions."

"Allow space for participants to demonstrate expertise before digging deeper in interviews."

"It’s important to put the participant at ease and not add to their cognitive burden."

"People generally want to help and tell what they genuinely believe; they’re just terrible at accurate recall."

"Creativity is needed right from the research stage, not just in solution design."

"The purpose of research is paramount; it guides the choice of methods and how rigorously to apply them."

"If you don’t have researchers to shadow, lean on communities, data scientists, or industry organizations."

"Asking for help and humbling yourself is one of the most powerful ways to grow as a researcher."

Ask the Rosenbot
Aditi Ruiz
A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1
2022 • Design in Product 2022
Gold
Kim Lenox
Leading Distributed Global Teams
2019 • Enterprise Community
Erin Hauber
Design is Not the Frosting on the Scaled Agile Layer Cake
2019 • DesignOps Summit 2019
Gold
Wendy Johansson
Design at Scale: Behind the Scenes
2021 • Enterprise Community
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group
Michal Anne Rogondino
Saving Outer Space: The First UX Design System for Our Nation’s Satellites
2024 • Enterprise Experience 2020
Gold
Joshua Graves
We Need To Talk: Addressing Unmet Expectations (Part 2 of 3)
2025 • Rosenfeld Community
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold
Laura Gatewood
Beyond Buzzwords: Adding Heart to Effective Slack Communication
2024 • DesignOps Summit 2024
Gold
Jilanna Wilson
Distributed DesignOps Management
2019 • DesignOps Community
Abbey Smalley
Scaling UX Past the Size of Your Team
2024 • Enterprise Experience 2020
Gold
Carl Turner
You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
2023 • Advancing Research 2023
Gold
Ryan Matthew
Bridging Design and Code: AI-Powered Design System Integration
2025 • DesignOps Summit 2025
Gold
Alfred Kahn
A Seat at the Table: Making Your Team a Strategic Partner
2023 • Design in Product 2023
Gold
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
Sharbani Dhar
Breathing Room for Delight
2024 • Enterprise Experience 2020
Gold

More Videos

Saara Kamppari-Miller

"You have to repeat your message about inclusion multiple times before people really hear it and change happens."

Saara Kamppari-Miller

Inclusive Design is DesignOps

September 29, 2021

Catherine Dubut

"No one really knows what to expect anyway, so failure goes largely unnoticed. It's better to be transparent about the mess."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Bria Alexander

"Respect and kindness are mandatory; please read our code of conduct to ensure a positive community experience."

Bria Alexander

Opening Remarks

September 9, 2022

Tricia Wang

"Positive mutual regard helps uncover root causes behind people’s behaviors to build collaboration rather than combat."

Tricia Wang

SCALE: Discussion

June 15, 2018

Peter Van Dijck

"Sometimes you have to build stuff and learn from it rather than wait for the perfect moment or tools."

Peter Van Dijck Louis Rosenfeld

Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood

June 14, 2024

Jason Mesut

"Omni Oppressors try to do everything, resulting in micromanagement and harming organizational culture."

Jason Mesut Martina Hodges-Schell Jose Coronado

Unmasking Design Leadership: Navigating leadership without neglecting ourselves

October 30, 2025

Peter Van Dijck

"Building evals is like building tests to know if your AI system is good enough, and you can rerun them as models improve."

Peter Van Dijck

Designing AI-first products on top of a rapidly evolving technology

June 10, 2025

Caroline Jarrett

"Statistics is hard because you have to flip flop in your head: think of a hypothesis, then a null hypothesis, then try to disprove the null."

Caroline Jarrett Erin Weigel

Have fun with statistics?

December 12, 2024

Dorelle Rabinowitz

"The key is of course trust, but in my house the magic word is please."

Dorelle Rabinowitz

The Magic Word is Trust

June 15, 2018