Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Wednesday, September 4, 2024 • Advancing Research Community
Share the love for this talk
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Speakers: Sam Ladner , Megan Blocker , Tanvi Dhond , Katie Hansen and Ricardo Martins
Link:

Summary

Researchers are being asked to help address challenges that are increasingly complex, strategic, and high-stakes. Our toolkit of methods needs to keep up with those challenges, as does our confidence and comfort with choosing, using, and combining those methods. Our Methods panelists will describe some of the exciting techniques they’re applying in their work, and discuss how they’ve overcome barriers to enriching their UXR toolkits. Attend all of our Advancing Research community workshops Each free virtual workshop is made up of panelists who will share short provocations on engaging ideas to discuss as a group, as well as a leader in our field to moderate. If you're looking for discussions that challenge the status quo and can truly advance research, look no further than our workshop series. (P.S. We’ll be drawing most of our Advancing Research 2025 conference speakers from those who present at upcoming workshops—so tune in for a sneak peek of what's to come from #AR2025!) July 24, 4-5pm EDT Watch Video Theme 1: Democratization Working with it, not against August 7, 11am-12pm EDT Watch Video Theme 2: Collaboration Learning from market research, data science, customer experience, and more August 21, 4-5pm EDT Watch Video Theme 3: Communication Innovative techniques for making your voice heard September 18, 4-5pm EDT Watch Video Theme 5: Artificial Intelligence Passionate defenses, reasoned critiques, and practical application October 2, 11am-12pm EDT Watch Video Theme 6: Junctures for UXR Possible futures and the critical decisions to move us forward October 16, 4-5pm EDT Watch Video Theme 7: Open Call Propose ideas that don’t match our other workshops’ themes

Key Insights

  • Mixed methods research—combining qualitative and quantitative approaches—deepens understanding beyond what interviews alone can offer.

  • Participant comfort and rapport are crucial to mitigating unconscious bias and eliciting authentic responses in any research method.

  • Quantitative techniques like conjoint analysis reveal statistically significant trade-offs and patterns that interviews cannot reliably capture.

  • Observational methods such as contextual inquiry expose workarounds and behaviors users may be unaware of or unable to articulate.

  • Stakeholder buy-in requires pragmatism and clear alignment of methods to research questions and participants’ needs.

  • Researchers often lean on interviews as a 'crutch' despite better-suited alternatives existing for certain questions.

  • Shadowing and learning from colleagues across disciplines, including data analysts and scientists, enriches research skills.

  • Community-based participatory research expands inclusivity and leverages insider knowledge to reach marginalized groups sensitively.

  • Interview questions must derive from research questions creatively rather than directly asking for attitudes or solutions.

  • The role and responsibility of the researcher includes managing participant burden, bias, and ensuring data validity based on impact level.

Notable Quotes

"User interviews are an absolute mainstay but it's important to be aware of the breadth of available methods."

"Some people lie, so mixing methods helps triangulate reality beyond what anyone says."

"Interviews are incredible for exploring unknown spaces but watching people at work reveals unseen opportunities."

"Setting participants at ease is essential to get to some of the truth."

"People are not there for us to extract from; they're often genuinely trying to help even if they don’t have all the answers."

"You don’t need to be an expert in every methodology but should know when to use them and find experts when needed."

"Community-based organizations can help researchers access deep contextual knowledge that outsiders would never have."

"Interviews alone are not a matter of angel or devil—they are useful if used responsibly and creatively."

"The biggest mistake beginners make is confusing research questions with direct interview questions."

"If interviews didn’t exist, our richness of insights would remain strong by pivoting to alternative research methods."

Ask the Rosenbot
Peter Merholz
The Mysterious Case of the Missing UX Career Path (Videoconference)
2022 • DesignOps Community
Mike Brzozowski
UX in everyday products: Empowering climate conscious choices (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Erik Flowers
Introduction to MURAL for UX
2021 • Design at Scale 2021
Gold
Phil Gilbert
A Consistent Culture of Design
2015 • Enterprise UX 2015
Gold
Civic Design in 2022 (Videoconference)
2022 • Civic Design Community
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • DesignOps Summit 2023
Gold
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Discussion
2017 • Enterprise Experience 2017
Gold
Frances Yllana
The Big Question about Impact: A Panel Discussion
2024 • DesignOps 2024
Gold
Monty Hammontree
The Future of UX Research (Videoconference)
2020 • Advancing Research Community
Theresa Marwah
How Atlassian is Operationalizing Respect in Research (Videoconference)
2020 • Advancing Research Community
Julie Baher
Culture Change—My Journey
2015 • Enterprise UX 2015
Gold
Kim Holt
A Salesforce Panel Discussion on Values-Driven DesignOps
2022 • DesignOps Summit 2022
Gold
Russell Blair
[Case study] Killing the blank page
2024 • Designing with AI 2024
Gold
Ross Smith
Breaking Barriers with Empathy
2017 • Enterprise Experience 2017
Gold

More Videos

Alex Hurworth

"Policies must evolve to reflect the urgency of our situation."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"We wanted to actively promote the Design Ops discipline to more people, especially those not familiar with our craft."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"We stopped talking about patterns and consistency and started talking about scalability and speed to connect with stakeholders."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"Rather than aiming for the chief strategy officer directly, build relationships with junior strategists who are more accessible."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"The smaller screen makes it easier to angle the device for adequate viewing, which computers just can’t replicate."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"If your design team cannot act quickly on findings, rapid research is not the method for you."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"We are at an inflection point where what got us here won't get us to a thriving future."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"The real question is what is it about delivering the value of design at scale."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"The most important thing is producing something that gives a perspective nobody else in the organization can bring."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021