Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 2 Theme Panel

Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Day 2 Theme Panel
Speakers: Megan Blocker , Amy Bucher , Katie Hansen , Ricardo Martins and Nidhi Singh Rathore
Link:

Summary

Panelists including Nadi, Amy, Katie, Ricardo, and others explored how researchers are adapting their methods to the changing dynamics between participants, researchers, and organizations. Nadi emphasized the importance of an open mind and mixed methods to uncover insights and critique tools used. Amy highlighted the need to say yes to new methods, running pilots, and staying up-to-date with emerging tools, while managing client demands. Ricardo noted that switching methods comes when existing tools can’t answer key research questions or have biases and shared inspiration from conferences. The group also discussed participatory methods, experimental designs, and the redemption of focus groups. Integrating qualitative and quantitative data and using live stories helped keep the participant experience front and center for stakeholders. Amy and others shared balancing faster, lighter studies with deeper, longer-term academic research to achieve organizational buy-in. Challenges in dealing with stakeholders who have predetermined solutions were discussed, with advice to align on shared goals and pick battles wisely to maintain research objectivity and impact. Concepts like right-sizing research (Ricardo, Nadi), systems thinking, and Lean Research principles were introduced to respect communities and strategically influence organizations. Finally, panelists recommended mentoring, community engagement, offering simple tools, and gradual experimentation to upskill researchers and colleagues new to the craft. Megan shared work on a research method playbook with a quadrant guiding new practitioners on when and how to try methods safely. The conversation underscored that research is a dynamic craft blending strategy, empathy, experimentation, and organizational navigation.

Key Insights

  • •

    Switching to a new research method often occurs when current methods cannot adequately answer the research question or have inherent biases, as Ricardo explained.

  • •

    A mixed-methods and cross-functional approach allows researchers to address gaps one tool alone cannot fill, advocated by Nadi.

  • •

    Leaders like Amy encourage saying yes to team experimentation with novel tools and running pilots to evolve the research toolkit.

  • •

    Participatory and experimental methods are gaining renewed interest, with attempts to redeem sometimes maligned methods like focus groups.

  • •

    Combining qualitative data such as video and quotes with quantitative findings helps keep participant experiences vivid for stakeholders.

  • •

    Right-sizing research—both in participant group size and project scope—is critical to respect community burden and project constraints, as emphasized by Ricardo and Nadi.

  • •

    Balancing fast, lighter UX studies with longer academic or in-depth research enables continuous insight delivery and organizational patience for complexity, shared by Amy.

  • •

    Navigating stakeholder resistance requires aligning on shared organizational goals, choosing battles carefully, and emphasizing research objectivity, as experienced by the panelists.

  • •

    Lean Research principles focusing on respect, relevance, and appropriate scale offer frameworks for conducting equitable and community-sensitive research.

  • •

    Upskilling less experienced researchers benefits from mentorship, community involvement, sharing simple tools and templates, and introducing safe spaces to experiment with methods.

Notable Quotes

"Tools don't matter as much as the desire to learn and ask why things keep happening the way they do."

"We say yes when teammates are curious to try new methods and run pilots to see what works and what could improve."

"When surveys measure attitude but not behavior, it's time to try methods like conjoint analysis that reduce bias."

"Focus groups have been called a curse, but I'm giving them a second chance to see if there’s something positive there."

"Combining numbers with rich participant videos and quotes really brings the user to life for stakeholders."

"Right sizing research respects communities by matching the scope to what participants can reasonably engage with."

"Slowing down research creates equitable spaces where minority and marginalized voices can be meaningfully included."

"You have to pick your battles with stakeholders—fight the ones that really matter and let smaller issues slide."

"Use systems thinking to connect insights and show how research impacts organizational strategy holistically."

"Giving someone a tool to try a method in an hour can either inspire them or clearly show it's not a fit."

Ask the Rosenbot
Mitchell Bernstein
Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape
2021 • DesignOps Summit 2021
Gold
Russ Unger
Onboarding: The Ecosystem, not the Afterthought
2017 • DesignOps Summit 2017
Gold
Sam Ladner
Data Exhaust and Personal Data: Learning from Consumer Products to Enhance Enterprise UX
2016 • Enterprise UX 2016
Gold
Abbey Smalley
Today’s Design Ops and Programs Landscape & Career Paths
2023 • DesignOps Summit 2023
Gold
Samuel Martin
Co-Design vs Faux-Design: Navigating the Complexities of Sharing Power in Co-Design
2026 • Rosenfeld Community
Sandra Camacho
Creating More Bias-Proof Designs
2025 • Rosenfeld Community
James Lang
Hopeful Futures for UX Research
2026 • Rosenfeld Community
Andreas Huebner
What Is It Like To Be Part of The UX Team at Compass?
2021 • Advancing Research 2021
Gold
Cheryl Platz
Demystifying Multimodal Design: The Design Practice You Didn't Know You're Doing
2024 • Rosenfeld Community
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • DesignOps Summit 2023
Gold
Maish Nichani
Sparking a Service Excellence Mindset at a Government Agency
2021 • Civic Design 2021
Gold
Matt Duignan
Atomizing Research: Trend or Trap
2020 • Advancing Research 2020
Gold
Craig Villamor
Design Systems for Ethical Design
2023 • Enterprise Community
Jack Moffett
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
2022 • Enterprise Community
Nicole Aleong
What UX research can learn from other research practices [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Katie Johnson
Disrupting generative AI products with just-in-time consumer insights
2024 • Designing with AI 2024
Gold

More Videos

Yoel Sumitro

"Students cannot be taught what they need to know; they can only be coached to absorb it through demonstration."

Yoel Sumitro

Actions and Reflections: Bridging the Skills Gap among Researchers

March 9, 2022

Sam Proulx

"Mobile screen readers can confirm basic accessibility but desktop testing is still needed due to differences across tools."

Sam Proulx

Mobile Accessibility and You

June 9, 2022

Dalia El-Shimy

"People broadly fall into three communication styles: positive, fact-based, and intensity-based."

Dalia El-Shimy

So You've Got a Seat at the Table. Now What?

March 31, 2020

Jemma Ahmed

"The system we rely on is ironically an approximation engine, like large language models that calculate approximations."

Jemma Ahmed Subhasree Chatterjee Robert Fabricant Alexandra Jayeun Lee Ben Robins

Collaboration: learning from other fields beyond our own [Advancing Research Community Workshop Series]

August 7, 2024

Randolph Duke II

"Flat Carol was a nearly life-size cardboard cutout of Carol."

Randolph Duke II

War Stories LIVE! Randy Duke II

March 30, 2020

Laura Weiss

"Ask permission before giving feedback, and do it in a timely, private setting for constructive criticism."

Laura Weiss

There is No Playbook: Leader as Coach During Challenging Times

April 26, 2024

Landon Barnes

"Meaningfulness is linked directly to what your organization cares about in terms of goals and priorities."

Landon Barnes

Are My Research Findings Actually Meaningful?

March 10, 2022

Dr. Jamika D. Burge

"AI cannot do empathy; moderated usability testing requires the human ability to pivot and connect."

Dr. Jamika D. Burge Nick Fine Alexandra Jayeun Lee Greg Nudelman Bo Wang

How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]

August 31, 2023

Jonathon Colman

"Working this way is unsustainable at best and set up for failure at worst."

Jonathon Colman

How to Maximize the Impact of Content Design

January 8, 2024