Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Wednesday, September 4, 2024 • Advancing Research Community
Share the love for this talk
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Speakers: Sam Ladner , Megan Blocker , Tanvi Dhond , Katie Hansen and Ricardo Martins
Link:

Summary

Researchers are being asked to help address challenges that are increasingly complex, strategic, and high-stakes. Our toolkit of methods needs to keep up with those challenges, as does our confidence and comfort with choosing, using, and combining those methods. Our Methods panelists will describe some of the exciting techniques they’re applying in their work, and discuss how they’ve overcome barriers to enriching their UXR toolkits. Attend all of our Advancing Research community workshops Each free virtual workshop is made up of panelists who will share short provocations on engaging ideas to discuss as a group, as well as a leader in our field to moderate. If you're looking for discussions that challenge the status quo and can truly advance research, look no further than our workshop series. (P.S. We’ll be drawing most of our Advancing Research 2025 conference speakers from those who present at upcoming workshops—so tune in for a sneak peek of what's to come from #AR2025!) July 24, 4-5pm EDT Watch Video Theme 1: Democratization Working with it, not against August 7, 11am-12pm EDT Watch Video Theme 2: Collaboration Learning from market research, data science, customer experience, and more August 21, 4-5pm EDT Watch Video Theme 3: Communication Innovative techniques for making your voice heard September 18, 4-5pm EDT Watch Video Theme 5: Artificial Intelligence Passionate defenses, reasoned critiques, and practical application October 2, 11am-12pm EDT Watch Video Theme 6: Junctures for UXR Possible futures and the critical decisions to move us forward October 16, 4-5pm EDT Watch Video Theme 7: Open Call Propose ideas that don’t match our other workshops’ themes

Key Insights

  • Mixed methods research—combining qualitative and quantitative approaches—deepens understanding beyond what interviews alone can offer.

  • Participant comfort and rapport are crucial to mitigating unconscious bias and eliciting authentic responses in any research method.

  • Quantitative techniques like conjoint analysis reveal statistically significant trade-offs and patterns that interviews cannot reliably capture.

  • Observational methods such as contextual inquiry expose workarounds and behaviors users may be unaware of or unable to articulate.

  • Stakeholder buy-in requires pragmatism and clear alignment of methods to research questions and participants’ needs.

  • Researchers often lean on interviews as a 'crutch' despite better-suited alternatives existing for certain questions.

  • Shadowing and learning from colleagues across disciplines, including data analysts and scientists, enriches research skills.

  • Community-based participatory research expands inclusivity and leverages insider knowledge to reach marginalized groups sensitively.

  • Interview questions must derive from research questions creatively rather than directly asking for attitudes or solutions.

  • The role and responsibility of the researcher includes managing participant burden, bias, and ensuring data validity based on impact level.

Notable Quotes

"User interviews are an absolute mainstay but it's important to be aware of the breadth of available methods."

"Some people lie, so mixing methods helps triangulate reality beyond what anyone says."

"Interviews are incredible for exploring unknown spaces but watching people at work reveals unseen opportunities."

"Setting participants at ease is essential to get to some of the truth."

"People are not there for us to extract from; they're often genuinely trying to help even if they don’t have all the answers."

"You don’t need to be an expert in every methodology but should know when to use them and find experts when needed."

"Community-based organizations can help researchers access deep contextual knowledge that outsiders would never have."

"Interviews alone are not a matter of angel or devil—they are useful if used responsibly and creatively."

"The biggest mistake beginners make is confusing research questions with direct interview questions."

"If interviews didn’t exist, our richness of insights would remain strong by pivoting to alternative research methods."

Ask the Rosenbot
Sarah Barrett
AI in Real Life: Using LLMs to Turbocharge Microsoft Learn
2025 • Rosenfeld Community
John Calhoun
Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam
2023 • DesignOps Summit 2023
Gold
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Kate Towsey
Ask Me Anything (AMA) with Kate Towsey
2025 • Rosenfeld Community
Andy Barraclough
From Costly Complexity to Efficient Insights: Why UX Teams Are Switching To Voxpopme
2024 • DesignOps 2024
Gold
Louis Rosenfeld
The Bigger Picture: A Panel Discussion
2019 • DesignOps Summit 2019
Gold
Corey Long
Hiring in DesignOps: A Critical Study on How to Hire and Get Hired
2024 • DesignOps 2024
Gold
Teresa Swingler
Look, Up in the Sky! UX/UI for Aerospace (Videoconference)
2022 • Enterprise Community
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • DesignOps Summit 2023
Gold
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold
Fisayo Osilaja
[Demo] The AI edge: From researcher to strategist
2024 • Designing with AI 2024
Gold
Frances Yllana
Theme 2 Intro
2024 • DesignOps 2024
Gold
Michele Wong
Helping Them Help Us
2024 • Enterprise Experience 2020
Gold
Trisha Causley
[Demo] Complexity in disguise: Crafting experiences for generative AI features
2024 • Designing with AI 2024
Gold
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold

More Videos

Angelos Arnis

"There is no such thing as a single issue struggle because we do not live single issue lives — bell hooks."

Angelos Arnis

Navigating the Rapid Shifts in Tech's Turbulent Terrain

October 2, 2023

John Calhoun

"We are writing the definitive guide because there is no single book dedicated entirely to design ops."

John Calhoun Rachel Posman

Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam

October 3, 2023

Alfred Kahn

"Design systems typically lack content on when and how to use components—adding this makes design more self-service."

Alfred Kahn

A Seat at the Table: Making Your Team a Strategic Partner

November 29, 2023

Dan Willis

"I should have brought you along on this journey instead of scheduling a big meeting — I was wrong."

Dan Willis

Enterprise Storytelling Sessions

June 3, 2019

John Maeda

"You have to give respect to get respect—it's the foundation for connecting people across teams."

John Maeda Alison Rand

About Design Organizations (Videoconference)

May 13, 2019

Anat Fintzi

"Our product managers look at UX as an opportunity for discovery, not as a stakeholder to question."

Anat Fintzi Rachel Minnicks

Delivering at Scale: Making Traction with Resistant Partners

June 9, 2022

Uday Gajendar

"Creating tangible artifacts forces reaction and debate, helping break enterprise paralysis and drive decisions."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Kristin Skinner

"There was a need around definition but also understanding the value our teammates would find in this role."

Kristin Skinner

Theme 1 Intro

September 29, 2021

Maish Nichani

"Service centers were transformed from crowded, threatening environments into spaces that look like five-star hotels with personalized kiosks and family cabanas."

Maish Nichani

Sparking a Service Excellence Mindset at a Government Agency

December 9, 2021