Summary
In this high-pressure scenario, the challenge was to conduct 17 user interviews in three days and synthesize a comprehensive report in just one additional day. I’ll explore how we used AI to streamline the research process, from transcription to synthesis, and how tools like ChatGPT contributed to efficient data processing and insight generation. We’ll reflect on the potential and pitfalls of using AI in accelerated user research, from practical aspects to more philosophical considerations on potential changes to the research process. Takeaways Practical insights into integrating AI with traditional research methodologies to expedite the research process An overview of the effectiveness of AI transcription and synthesis tools in real-world research scenarios Critical examination of AI's role in data processing and how it compares with human analysis Strategic considerations for service designers when employing AI to support rapid user research Reflection on the ethical implications and potential impact on the quality of insights and researcher well-being when relying on AI to speed up research processes
Key Insights
-
•
Generative AI can significantly speed up text generation and help brainstorm clustering parameters in research synthesis.
-
•
AI struggles to assign specific interviewees to user archetypes without detailed human guidance.
-
•
The best use of AI involves a semi-automated process combining AI brainstorming with human refinement.
-
•
Automated visuals generated by DALL·E often fail to accurately represent complex user concepts.
-
•
AI behaves like an 'alien intern,' lacking common sense and understanding of research processes.
-
•
Providing AI with explicit details like participant names improves clustering and assignment accuracy.
-
•
AI can efficiently retrieve specific quotes from transcripts when given open-ended queries.
-
•
Human experience is crucial to evaluate and guide AI outputs, preventing misleading or irrelevant results.
-
•
AI reduces cognitive overload and accelerates synthesis during tight deadlines and solo work.
-
•
Rapid AI-assisted research risks sacrificing depth and nuance of human insights for speed.
Notable Quotes
"Gene AI can really help to speed up some certain synthesis moments, especially those connected to textual content generation and navigation."
"AI behaves kind of like an alien intern because it’s not capable of making sense of some things which are easy for us."
"I had to adapt and follow a semi-automated process where I would brainstorm a lot of things with AI, then define many things by myself."
"The biggest superpower of ChatGPT right now is generating textual descriptions along the given format when it understands it and the relevance."
"Visuals are not working that well with DALL·E in this context, despite multiple instructions to remove cables or irrelevant elements."
"AI can provide multiple inputs that stimulate human thinking even if many are generic and need human filtering."
"You need to guide AI a lot and do handholding, even reminding it simple things like how many people are in the transcript."
"It’s better to have a human, but if you don’t, AI can be a partner in the process to speed things up."
"The value is not so much about the results but about helping manage cognitive overload and speed up the process under tight deadlines."
"AI making the process five times faster is worrying if it means losing the depth of human insights for speed and efficiency."
Dig deeper—ask the Rosenbot:
More Videos
"UX online benchmarking offers a fast and efficient way to identify strengths and weaknesses compared to competitors."
Daniela Magaña Flores Ariane Rahn Jeff Ephraim BanderAhead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
March 10, 2022
"The art of prompt design shares a strong connection with the art of conducting interviews and creating discussion guides."
Savina HawkinsHarnessing AI in UXR: Practical Strategies for Positive Impact
March 26, 2024
"Knowledge is power; empowering communities leads to better conservation outcomes."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"Building a custom repository is resource intensive, but offers control necessary for large organizations like Microsoft."
Matt DuignanHITS, Microsoft's internal human insight system: From research library to living body of knowledge (Videoconference)
July 16, 2019
"Make it easy to do the right thing, and as a side effect, make it harder to do the wrong thing - guiding principle from Salesforce Lightning Design System."
Craig VillamorDesign Systems for Ethical Design (Videoconference)
January 26, 2023
"Move from thoughts to things — the faster you get something tangible, the faster people stop debating opinions."
Ovetta SampsonTurning UX Passion into Real Product Influence
June 7, 2023
"Most creative teams are always teetering on the edge of greatness."
Rima Campbell Amrit S BhachuIncrease Productivity and Drive Business Impact
September 24, 2024
"We had to negotiate getting Figma behind our single sign-on to ensure security, and it took multiple calls."
Amy Gawronski ZuccaroAdvice for DesignOps Employee #1
September 29, 2021
"We have to move into radical participatory research where researcher is community member."
Victor UdoewaBeyond Methods and Diversity: The Roots of Inclusion
March 26, 2024
