Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

[Demo] Complexity in disguise: Crafting experiences for generative AI features
Gold
Wednesday, June 5, 2024 • Designing with AI 2024
Share the love for this talk
[Demo] Complexity in disguise: Crafting experiences for generative AI features
Speakers: Trisha Causley
Link:

Summary

AI tools like ChatGPT have exploded in popularity with good reason: they allow users to draft, summarize, and edit content with unprecedented speed. While these generic tools can generate any type of content or perform any type of content task, the user needs to craft an effective prompt to get high-quality output, and often needs to exchange multiple messages with additional guidance and requirements in order to improve results. When you’re building an AI-powered text generation feature, such as a product description or email writer, you typically can’t expect users to craft their own prompts. And unless you’re building a chat interface, you’re unlikely to offer the ability to iteratively improve the output. Instead, your feature needs a robust prompt skeleton that combines with user input to produce high-quality output in a single response. For the designer, this means building an interface that helps users provide the exact information that creates a successful prompt. This process is more complex than simple form design or a mad-lib prompt completion tool. The user input, often including free form text fields, might be required to fill in prompt variables, but it also could change the prompt structure itself, or even override base instructions. The effectiveness of the user input significantly influences the quality of the output, underscoring the need for designers to be deeply familiar with the backend prompt architecture so they can design the frontend. Drawing on recent text generation projects, I'll demonstrate how the interface design can respond to and evolve with the prompt architecture. I’ll talk about how to determine which prompt components to make invisible to the user, which to provide as predefined options, and which should be authored by the user in free-form text fields. Takeaways How prompt structure can impact user interface design and conversely, how design can impact prompt structure Techniques to provide effective user guidance within AI generation contexts to ensure consistently high-quality output Real-world examples and learnings from recent generative AI projects in an e-commerce software product

Key Insights

  • Designing AI text generation features requires predefining most of the prompt to ensure quality output, unlike general chat interfaces where users craft their own prompts.

  • Users should provide only essential variable inputs like product name, keywords, tone, and length while the rest of the prompt remains fixed and optimized by designers.

  • Free-text tone input confuses many users, making predefined tone options a better UX solution for brand-consistent content generation.

  • Providing six distinct, well-differentiated tones helps merchants easily select a voice that fits their brand and produce unique product descriptions.

  • Tone labels need to cover sufficiently different style zones, avoiding overlaps such as conversational vs friendly or witty vs humorous.

  • Detailed linguistic instructions behind each tone dropdown option improve output consistency, including vocabulary choice, pronouns, punctuation, and syntactic style.

  • Using AI to detect tone from existing website content is unreliable; the model gives inconsistent outputs with unjustified high confidence.

  • Balancing configurability and fixed prompt instructions is a core design challenge when building AI features with limited iterative prompting.

  • The UI must simplify complex prompt engineering by presenting users these configuration options in an intuitive and minimal way.

  • Generative AI models often default to a confident, positive tone, which designers need to explicitly adjust through persona prompts if a different tone is desired.

Notable Quotes

"If the user isn’t happy with the output, they might be able to change some of the inputs and try again, but the base instructions are predefined."

"When you’re building a specific AI feature, you don’t want to make your user write their own prompt."

"A prompt is a set of directions given to an LLM to generate text that meets criteria like format, length, tone, or topic."

"The tone of voice field turned out to be a much more complicated variable than it appears."

"Merchants often sell really similar products, so tone differentiated suggestions help them stand out with unique descriptions."

"People get stuck trying to articulate their brand voice in just one or two words during user testing."

"The LLM gave many different answers for the same passage and always reported it was 100% confident."

"Tones need to be distinct enough from each other so merchants can easily spot which one fits best."

"We had a quite a bit more detail in the prompt about vocabulary, pronouns, punctuation, and syntactic instructions for each tone."

"By default, generative AI has a very convincing, confident tone that never hedges, and you have to build other tones explicitly."

Ask the Rosenbot
Melissa Tsang
From Insights to Action: Driving Business Values through DesignOps
2024 • DesignOps Summit 2020
Gold
Harry Max
Prioritization for Leaders (2nd of 3 seminars) (Videoconference)
2024 • Rosenfeld Community
Dane DeSutter
Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)
2024 • QuantQual Interest Group (Rosenfeld Community)
Dianne Que
Real Talk: Proving Value through a Scrappy Playbook
2019 • DesignOps Summit 2019
Gold
Carl Turner
You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
2023 • Advancing Research 2023
Gold
Nina Jurcic
The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
2023 • DesignOps Summit 2023
Gold
Cheryl Platz
Merging Improv with Design (Videoconference)
2019 • Enterprise Community
Josh Clark
Sentient Design: New Design Patterns for New Experiences (3rd of 3 seminars)
2025 • Rosenfeld Community
Brendan Jarvis
Framing Tomorrow by Questioning Today
2022 • Design at Scale 2022
Gold
Cara Maritz
The Art of Extrapolation
2023 • Advancing Research 2023
Gold
Bria Alexander
Opening Remarks Day 2
2024 • Advancing Research 2024
Gold
Alexandra Schmidt
Enterprise UX Playbook (Videoconference)
2022 • Enterprise Community
Bria Alexander
Welcome
2022 • DesignOps Summit 2022
Gold
Bria Alexander
Reflect and Chart Forward
2021 • Civic Design 2021
Gold
Clara Kliman-Silver
UX Futures: The Role of Artificial Intelligence in Design
2023 • Enterprise UX 2023
Gold
Ren Pope
Building Experiences for Knowledge Systems
2023 • Enterprise UX 2023
Gold

More Videos

Catt Small

"Creating evergreen design documents helps you influence projects asynchronously without being in every room."

Catt Small Micah Bennett Brian Carr Jessica Harllee

What's Next for ICs: Exploring Staff and Principal Designer Roles (Videoconference)

February 22, 2024

Jennifer Kong

"We released several incremental but imperfect pilot solutions to inform usability and strategy rather than relying on typical prototyping."

Jennifer Kong

[Case study] Journeying toward AI-assisted documentation in healthcare

June 5, 2024

Sara Logel

"People react to facts challenging their core beliefs the same way the brain responds to physical threats."

Sara Logel

Your Colleagues are Your Users Too

March 29, 2023

Veevi Rosenstein

"Implementing a ticketing workflow lets us track research requests and responses and build a stronger case for more headcount."

Veevi Rosenstein

Building for Scale: Creating the Zendesk UX Research Practice

January 8, 2024

Michelle Bejian Lotia

"Once we put all these insights into the repository, things we already have get so much more value."

Michelle Bejian Lotia Anne-Marie Morell

Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization

March 28, 2023

Tutti Taygerly

"Slow down to speed up means choosing not to react to your triggers and look at long-term shared goals."

Tutti Taygerly

Videconference: How to Work with Difficult People with Tutti Taygerly

June 25, 2020

Patrick Commarford

"Design advisors maintain relationships with designers and project teams to reassess staffing needs as project scope changes."

Patrick Commarford

Design Staffing for Impact

January 8, 2024

Frances Yllana

"Cultivating a leadership ecosystem that thrives on rapid change is key to sustainable impact."

Frances Yllana

Theme 2 Intro

September 24, 2024

Mujtaba Hameed

"It’s okay if your first visual looks weird or even like a penis—that’s part of the process."

Mujtaba Hameed

Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research

March 26, 2024