Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Friday, January 20, 2023 • QuantQual Interest Group (Rosenfeld Community)
Share the love for this talk
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
Speakers: Mohammad Hossein Jarrahi
Link:

Summary

This presentation addresses the contextuality problem of generating rich yet generalizable observations. It examines the contrasting approaches of qualitative and quantitative research in capturing user context and offers a pragmatic model for building meaningful connections between the two methods using the concepts of the 'context of discovery' and 'contexts of justification.

Key Insights

  • Quantitative research treats context as a stable container, isolating few variables to build generalizable models.

  • Qualitative research views context as dynamic, inseparable from people and phenomena, emphasizing thick, situated understanding.

  • There is a fundamental tension between uncertainty (lack of information) and complexity (too much information) in research.

  • The Technology Acceptance Model exemplifies quantitative reductionism focusing on perceived usefulness and ease of use.

  • Qualitative methods help uncover novel, innovative user behaviors often invisible in quantitative data.

  • Scholarly pragmatism enables bridging epistemological divides by focusing on what works practically rather than foundational truths.

  • Popper's distinction between the context of discovery (qualitative) and context of justification (quantitative) supports a complementary research cycle.

  • Edge cases like digital nomads provide rich qualitative data that, when tested quantitatively, can inform understanding of broader populations.

  • Quantitative methods reduce complexity, but often at the cost of ignoring important idiosyncratic contextual factors.

  • Collaboration across qualitative and quantitative paradigms is necessary to balance depth and breadth in UX and information research.

Notable Quotes

"I’m no UX person but I’m trying to engage with this community."

"A common answer in my class to any question is it depends; context matters more than good or bad answers."

"AI can handle narrow tasks but putting things into broader context remains a uniquely human ability."

"From afar, an ant’s trajectory may seem chaotic, but close-up, physical obstacles explain its movement."

"Quantitative research often abstracts away many variables to focus on causal relationships between a few."

"Qualitative research appreciates uniqueness and idiosyncrasies rather than reducing information."

"Paradigms have very different epistemologies, but pragmaticism focuses on what works rather than origins."

"Popper’s asymmetry says as long as a theory survives empirical testing, the context of origin matters less."

"The yin-yang philosophy embraces qualitative depth and quantitative breadth as complementary, not competitive."

"Solutions in design and research are always good for the time being—there is no perfect truth or perfect answer."

Ask the Rosenbot
Davis Neable
How to Drive a Design Project When you Don’t Have a Design Team
2021 • Design at Scale 2021
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • DesignOps Summit 2021
Gold
Greg Nudelman
Designing Conversational Interfaces (Videoconference)
2019 • Enterprise Community
Sarah Auslander
Insights Panel
2022 • Civic Design 2022
Gold
Alfred Kahn
A Seat at the Table: Making Your Team a Strategic Partner
2023 • Design in Product 2023
Gold
Catherine Dubut
Bridging Physical and Digital Spaces: Approaches to Retail Service Design (Videoconference)
2021 • Enterprise Community
Peter Boersma
How to Define and Maintain a DesignOps Roadmap
2023 • DesignOps Summit 2023
Gold
Laine Riley Prokay
How DesignOps can Drive Inclusive Career Ladders for All
2021 • DesignOps Summit 2021
Gold
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
Josina Vink
Navigating the pitfalls of systems thinking in service design
2024 • Advancing Service Design 2024
Gold
Megan Campos
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
2021 • Advancing Research 2021
Gold
Jemma Ahmed
Theme 2 Intro
2022 • Advancing Research 2022
Gold
Jemma Ahmed
Collaboration: learning from other fields beyond our own [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Adrian Howard
Sturgeon’s Biases
2024 • DesignOps 2024
Gold
Cheryl Platz
Demystifying Multimodal Design: The Design Practice You Didn't Know You're Doing (Videoconference)
2024 • Rosenfeld Community
Sam Ladner
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
2024 • Advancing Research Community

More Videos

Adam Cutler

"Can you show me your process, not just your portfolio? That shows me your real design thinking."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"If you’re doing a lot of work that’s not in your job description, you might actually be doing leadership."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"If you don’t tune it properly, sometimes you just don’t get what you want."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"Every small action contributes to a larger impact in the fight against climate change."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"It matters what you build, but it matters more if you learn."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"Factory owners manipulated people’s time so much that workers were afraid to carry a watch."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"Delivering research in small, lean increments allowed us to iterate fast and reduce bias."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"Our brains are terrible at operating only on one type of information, whether object-oriented or context-oriented."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"The conversion design process creates collective knowledge, which gets reinfused to strengthen future experiments."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024