Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Friday, January 20, 2023 • QuantQual Interest Group (Rosenfeld Community)
Share the love for this talk
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Speakers: Mohammad Hossein Jarrahi
Link:

Summary

This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.

Key Insights

  • Quantitative research treats context as a stable container, isolating few variables to build generalizable models.

  • Qualitative research views context as dynamic, inseparable from people and phenomena, emphasizing thick, situated understanding.

  • There is a fundamental tension between uncertainty (lack of information) and complexity (too much information) in research.

  • The Technology Acceptance Model exemplifies quantitative reductionism focusing on perceived usefulness and ease of use.

  • Qualitative methods help uncover novel, innovative user behaviors often invisible in quantitative data.

  • Scholarly pragmatism enables bridging epistemological divides by focusing on what works practically rather than foundational truths.

  • Popper's distinction between the context of discovery (qualitative) and context of justification (quantitative) supports a complementary research cycle.

  • Edge cases like digital nomads provide rich qualitative data that, when tested quantitatively, can inform understanding of broader populations.

  • Quantitative methods reduce complexity, but often at the cost of ignoring important idiosyncratic contextual factors.

  • Collaboration across qualitative and quantitative paradigms is necessary to balance depth and breadth in UX and information research.

Notable Quotes

"I’m no UX person but I’m trying to engage with this community."

"A common answer in my class to any question is it depends; context matters more than good or bad answers."

"AI can handle narrow tasks but putting things into broader context remains a uniquely human ability."

"From afar, an ant’s trajectory may seem chaotic, but close-up, physical obstacles explain its movement."

"Quantitative research often abstracts away many variables to focus on causal relationships between a few."

"Qualitative research appreciates uniqueness and idiosyncrasies rather than reducing information."

"Paradigms have very different epistemologies, but pragmaticism focuses on what works rather than origins."

"Popper’s asymmetry says as long as a theory survives empirical testing, the context of origin matters less."

"The yin-yang philosophy embraces qualitative depth and quantitative breadth as complementary, not competitive."

"Solutions in design and research are always good for the time being—there is no perfect truth or perfect answer."

Ask the Rosenbot
Matt Bernius
Learnings from Applying Trauma-Informed Principles to the Research Process
2022 • Advancing Research 2022
Gold
Discussion
2017 • Enterprise Experience 2017
Gold
Isaac Heyveld
Expand DesignOps Leadership as a Chief of Staff
2022 • DesignOps Summit 2022
Gold
Greg Petroff
Software as Material—A Redux
2023 • Enterprise UX 2023
Gold
Xenia Adjoubei
Empowering Communities Through the Researcher in Residence Program
2023 • Advancing Research 2023
Gold
Holly Cole
Understanding Experiences: When you have to do more than work
2018 • DesignOps Summit 2018
Gold
Michelle Morrison
Culture Design (Videoconference)
2020 • DesignOps Community
Bria Alexander
Theme 1 Intro
2024 • DesignOps 2024
Gold
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
Louis Rosenfeld
Coffee with Lou #3: What Makes for a Successful UX Conference Presentation? (Videoconference)
2024 • Rosenfeld Community
Sam Proulx
Mobile Accessibility and You
2022 • Design at Scale 2022
Gold
Bria Alexander
Reflect and Chart Forward
2021 • Civic Design 2021
Gold
Jonathan Fairman
Integrating generative AI into enterprise products: A case study from dscout
2024 • Designing with AI 2024
Gold
Chris Govias
Perspectives on Civic Design (Videoconference)
2021 • Civic Design Community
Jim Kalbach
Jobs To Be Done (Videoconference)
2021 • Enterprise Community

More Videos

Alex Hurworth

"Restoration is not just about replanting trees; it’s about rebuilding entire ecosystems."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"Investing in new practitioners is mutually rewarding; we learn from their fresh perspectives and reassess what we know ourselves."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"Everyone wanted to know what was the official pattern and who was accountable for it."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"The most important value delivered to customers is always the qualitative value—the emotional and experiential impact."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"The smaller screen makes it easier to angle the device for adequate viewing, which computers just can’t replicate."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"The program creates predictability so teams know when to submit questions and when findings will come."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"You have the power, like Navy Seals of user research, to influence the biggest issues of our time, one interaction at a time."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"You can’t measure long-term customer relationship value with short-term KPIs."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"One analyst became our research associate by diving deep into the diary videos and organizing the data."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021