Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Wednesday, September 4, 2024 • Advancing Research Community
Share the love for this talk
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
Speakers: Sam Ladner , Megan Blocker , Tanvi Dhond , Katie Hansen and Ricardo Martins
Link:

Summary

Researchers are being asked to help address challenges that are increasingly complex, strategic, and high-stakes. Our toolkit of methods needs to keep up with those challenges, as does our confidence and comfort with choosing, using, and combining those methods. Our Methods panelists will describe some of the exciting techniques they’re applying in their work, and discuss how they’ve overcome barriers to enriching their UXR toolkits. Attend all of our Advancing Research community workshops Each free virtual workshop is made up of panelists who will share short provocations on engaging ideas to discuss as a group, as well as a leader in our field to moderate. If you're looking for discussions that challenge the status quo and can truly advance research, look no further than our workshop series. (P.S. We’ll be drawing most of our Advancing Research 2025 conference speakers from those who present at upcoming workshops—so tune in for a sneak peek of what's to come from #AR2025!) July 24, 4-5pm EDT Watch Video Theme 1: Democratization Working with it, not against August 7, 11am-12pm EDT Watch Video Theme 2: Collaboration Learning from market research, data science, customer experience, and more August 21, 4-5pm EDT Watch Video Theme 3: Communication Innovative techniques for making your voice heard September 18, 4-5pm EDT Watch Video Theme 5: Artificial Intelligence Passionate defenses, reasoned critiques, and practical application October 2, 11am-12pm EDT Watch Video Theme 6: Junctures for UXR Possible futures and the critical decisions to move us forward October 16, 4-5pm EDT Watch Video Theme 7: Open Call Propose ideas that don’t match our other workshops’ themes

Key Insights

  • Mixed methods research—combining qualitative and quantitative approaches—deepens understanding beyond what interviews alone can offer.

  • Participant comfort and rapport are crucial to mitigating unconscious bias and eliciting authentic responses in any research method.

  • Quantitative techniques like conjoint analysis reveal statistically significant trade-offs and patterns that interviews cannot reliably capture.

  • Observational methods such as contextual inquiry expose workarounds and behaviors users may be unaware of or unable to articulate.

  • Stakeholder buy-in requires pragmatism and clear alignment of methods to research questions and participants’ needs.

  • Researchers often lean on interviews as a 'crutch' despite better-suited alternatives existing for certain questions.

  • Shadowing and learning from colleagues across disciplines, including data analysts and scientists, enriches research skills.

  • Community-based participatory research expands inclusivity and leverages insider knowledge to reach marginalized groups sensitively.

  • Interview questions must derive from research questions creatively rather than directly asking for attitudes or solutions.

  • The role and responsibility of the researcher includes managing participant burden, bias, and ensuring data validity based on impact level.

Notable Quotes

"User interviews are an absolute mainstay but it's important to be aware of the breadth of available methods."

"Some people lie, so mixing methods helps triangulate reality beyond what anyone says."

"Interviews are incredible for exploring unknown spaces but watching people at work reveals unseen opportunities."

"Setting participants at ease is essential to get to some of the truth."

"People are not there for us to extract from; they're often genuinely trying to help even if they don’t have all the answers."

"You don’t need to be an expert in every methodology but should know when to use them and find experts when needed."

"Community-based organizations can help researchers access deep contextual knowledge that outsiders would never have."

"Interviews alone are not a matter of angel or devil—they are useful if used responsibly and creatively."

"The biggest mistake beginners make is confusing research questions with direct interview questions."

"If interviews didn’t exist, our richness of insights would remain strong by pivoting to alternative research methods."

Ask the Rosenbot
Gonzalo Goyanes
Design ROI: Cover a Little, Get a Lot
2022 • DesignOps Summit 2022
Gold
Savannah Carlin
[Case Study] Don't botch the bot: Designing interactions for AI
2024 • Designing with AI 2024
Gold
Alison Rand
Scaling Impact with Service Design (Videoconference)
2021 • DesignOps Community
Stephen Anderson
Puzzled? How to Coordinate Humans for Complex Challenges
2021 • Enterprise Community
Davis Neable
How to Drive a Design Project When you Don’t Have a Design Team
2021 • Design at Scale 2021
Gold
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold
Shipra Kayan
How Tess Dixon Facilitates Team Engagement and Collaboration at Condé Nast Using Miro 
2021 • DesignOps Summit 2021
Gold
Alana Washington
Theme 3 Intro
2021 • DesignOps Summit 2021
Gold
This Game is Never Done: Design Leadership Techniques from the Video Game World
2017 • DesignOps Summit 2017
Gold
Onur Kocan
Understanding the Strategy for Civic Design in a Complex City: Istanbul
2022 • Civic Design 2022
Gold
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Todd Healy
Driving Change with CX Metrics
2023 • Enterprise UX 2023
Gold
Sha Hwang
The Lost Year
2021 • Design at Scale 2021
Gold
Jennifer Kanyamibwa
Creating the Blueprint: Growing and Building Design Teams
2018 • DesignOps Summit 2018
Gold
Nina Jurcic
The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
2023 • DesignOps Summit 2023
Gold
Nova Wehman-Brown
We've Never Done This Before
2019 • Enterprise Experience 2019
Gold

More Videos

Jemma Ahmed

"Knowledge multiplies the more it’s shared, it’s not a zero-sum game where someone loses power."

Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher Nash

Democratization: Working with it, not against it [Advancing Research Community Workshop Series]

July 24, 2024

Nina Jurcic

"Customers rarely ask us to fix inconsistencies directly; we must watch activation rates and confusion instead."

Nina Jurcic

The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change

October 3, 2023

Nathan Curtis

"If your organization is healthy, the haters pretty quickly get marginalized when everyone else is excited about the design system."

Nathan Curtis Nalini P. Kotamraju Jack Moffett Dawn Ressel

Discussion

June 9, 2016

Saara Kamppari-Miller

"If we are working on something that does not ladder up to our KSPs, then we should not be working on it."

Saara Kamppari-Miller Nicole Bergstrom Shashi Jain

Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”

November 13, 2024

Malini Rao

"Designing for change management is just as important as the product experience strategy."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021

Mackenzie Cockram

"85% of people were leaving after just looking at one page on the old site—that was a huge problem."

Mackenzie Cockram Sara Branco Cunha Ian Franklin

Integrating Qualitative and Quantitative Research from Discovery to Live

December 16, 2022

Bria Alexander

"There is no need to take notes because we have sketch note makers capturing the sessions for you."

Bria Alexander

Opening Remarks

June 9, 2021

Jackie Ho

"Growth boards meetings are aimed around being very honest about the health of your product."

Jackie Ho

Lead Effectively While Preserving Team Autonomy with Growth Boards

January 8, 2024

Dan Hill

"Technology is inevitable or inescapable, it just proliferates, but we need to contain it."

Dan Hill

Designing for the infrastructures of everyday life

June 4, 2024