Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Wednesday, September 4, 2024 • Advancing Research Community
Share the love for this talk
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Speakers: Sam Ladner , Megan Blocker , Tanvi Dhond , Katie Hansen and Ricardo Martins
Link:

Summary

Researchers are being asked to help address challenges that are increasingly complex, strategic, and high-stakes. Our toolkit of methods needs to keep up with those challenges, as does our confidence and comfort with choosing, using, and combining those methods. Our Methods panelists will describe some of the exciting techniques they’re applying in their work, and discuss how they’ve overcome barriers to enriching their UXR toolkits. Attend all of our Advancing Research community workshops Each free virtual workshop is made up of panelists who will share short provocations on engaging ideas to discuss as a group, as well as a leader in our field to moderate. If you're looking for discussions that challenge the status quo and can truly advance research, look no further than our workshop series. (P.S. We’ll be drawing most of our Advancing Research 2025 conference speakers from those who present at upcoming workshops—so tune in for a sneak peek of what's to come from #AR2025!) July 24, 4-5pm EDT Watch Video Theme 1: Democratization Working with it, not against August 7, 11am-12pm EDT Watch Video Theme 2: Collaboration Learning from market research, data science, customer experience, and more August 21, 4-5pm EDT Watch Video Theme 3: Communication Innovative techniques for making your voice heard September 18, 4-5pm EDT Watch Video Theme 5: Artificial Intelligence Passionate defenses, reasoned critiques, and practical application October 2, 11am-12pm EDT Watch Video Theme 6: Junctures for UXR Possible futures and the critical decisions to move us forward October 16, 4-5pm EDT Watch Video Theme 7: Open Call Propose ideas that don’t match our other workshops’ themes

Key Insights

  • Mixed methods research—combining qualitative and quantitative approaches—deepens understanding beyond what interviews alone can offer.

  • Participant comfort and rapport are crucial to mitigating unconscious bias and eliciting authentic responses in any research method.

  • Quantitative techniques like conjoint analysis reveal statistically significant trade-offs and patterns that interviews cannot reliably capture.

  • Observational methods such as contextual inquiry expose workarounds and behaviors users may be unaware of or unable to articulate.

  • Stakeholder buy-in requires pragmatism and clear alignment of methods to research questions and participants’ needs.

  • Researchers often lean on interviews as a 'crutch' despite better-suited alternatives existing for certain questions.

  • Shadowing and learning from colleagues across disciplines, including data analysts and scientists, enriches research skills.

  • Community-based participatory research expands inclusivity and leverages insider knowledge to reach marginalized groups sensitively.

  • Interview questions must derive from research questions creatively rather than directly asking for attitudes or solutions.

  • The role and responsibility of the researcher includes managing participant burden, bias, and ensuring data validity based on impact level.

Notable Quotes

"User interviews are an absolute mainstay but it's important to be aware of the breadth of available methods."

"Some people lie, so mixing methods helps triangulate reality beyond what anyone says."

"Interviews are incredible for exploring unknown spaces but watching people at work reveals unseen opportunities."

"Setting participants at ease is essential to get to some of the truth."

"People are not there for us to extract from; they're often genuinely trying to help even if they don’t have all the answers."

"You don’t need to be an expert in every methodology but should know when to use them and find experts when needed."

"Community-based organizations can help researchers access deep contextual knowledge that outsiders would never have."

"Interviews alone are not a matter of angel or devil—they are useful if used responsibly and creatively."

"The biggest mistake beginners make is confusing research questions with direct interview questions."

"If interviews didn’t exist, our richness of insights would remain strong by pivoting to alternative research methods."

Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2019 • Enterprise Experience 2019
Gold
Theresa Marwah
How Atlassian is Operationalizing Respect in Research (Videoconference)
2020 • Advancing Research Community
Deanna Smith
Leading Change with Confidence: Strategies for Optimizing Your Process
2024 • DesignOps 2024
Gold
Stephanie Wade
Building and Sustaining Design in Government
2021 • Civic Design 2021
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Advancing Research 2023
Gold
Louis Rosenfeld
Becoming a Civic Designer: Making the Move from Private to Public Sector
2022 • Civic Design 2022
Gold
Gregg Bernstein
Opportunistic Research with Gregg Bernstein (Videoconference)
2019 • Advancing Research Community
Nicole Aleong
Future Orientations to Everyday Life: Futures Anthropology as a Methodology
2024 • Advancing Research 2024
Gold
Peter Boersma
How to Define and Maintain a DesignOps Roadmap
2023 • DesignOps Summit 2023
Gold
Sam Proulx
Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users
2021 • DesignOps Summit 2021
Gold
George Hinchliffe
Delivering Amazing Experiences
2021 • Design at Scale 2021
Gold
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps 2024
Gold
Indi Young
Thinking styles: Mend hidden cracks in your market
2025 • Rosenfeld Community
The Many Faces of Operations
2017 • DesignOps Summit 2017
Gold
Jennifer Strickland
Adopting a "Design By" Method
2021 • Civic Design 2021
Gold
Alfred Kahn
A Seat at the Table: Making Your Team a Strategic Partner
2023 • Design in Product 2023
Gold

More Videos

Wyatt Hayman

"We did all these analyses for each market and then fit the group to be proportional to key hosting and traveling characteristics."

Wyatt Hayman

Global Research Panels (Videoconference)

August 8, 2020

PJ Buddhari

"We have a Spectrum Guild that includes product designers and managers from every business unit to surface major changes and requests."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

Sarah Gallimore

"Government often moves slowly and struggles to communicate future intent amid short-term sustainability concerns."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Peter Merholz

"Knowing your subject matter as a UX leader is just as important as knowing your craft."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Dr. Jamika D. Burge

"Semiotics allows us to decode cultural shifts and understand where gender inequalities are embedded beneath the surface."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices (Videoconference)

September 15, 2022

Amy Marquez

"Product principles are minimal but help us say, oh, this is meeting that or not meeting that."

Amy Marquez

INVEST: Discussion

June 15, 2018

Dane DeSutter

"If you remove death in a game like Dark Souls, the game breaks — death is part of the challenge and fun."

Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl Platz

Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)

May 17, 2024

Zariah Cameron

"Denying the body is not an antidote to the suffering of the world. When we protect our rest, we protect our dreaming."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

Jessica Norris

"Having ADHD is like having a race car engine for a brain but with the brakes of a bicycle."

Jessica Norris

ADHD: A DesignOps Superpower

September 9, 2022