Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Fair and Effective Designer Evaluation
Gold
Wednesday, September 25, 2024 • DesignOps 2024
Share the love for this talk
Fair and Effective Designer Evaluation
Speakers: Ignacio Martinez
Link:

Summary

How do you evaluate designers fairly and effectively while providing a clear path toward career advancement? This is a question our organization has grappled with throughout our eight years as a company. Design can often be left up to gut reasoning by leadership and designers may not have a clear understanding of what their role means and how they may grow as designers. We’ve developed iterations of different tools and processes over the years to address these concerns and to evolve with our shifting needs as a growing company. All of which has led us to a robust tool that we’ve been using over the past two years which can serve as a model for how organizations can deploy qualitative career advancement. The session will cover our journey to this point and showcase the tools and processes we’ve deployed to make evaluation and career advancement systematic within a design organization along with surprising benefits and lessons we’ve learned along the way.

Key Insights

  • Grant Studio’s evaluation system uses a transparent, weighted career path covering craft, quality, client, and team categories to fairly assess designers.

  • Continuous anonymous feedback between team members after each project provides timely, goal-constrained input for growth.

  • Career managers mentor designers and advocate for their promotion and staffing based on synthesized feedback.

  • The career path tool is a customized Google Sheet to allow easy experimentation and full understanding of processes.

  • Craft and quality are weighted heavier for junior roles; client and team collaboration gain importance at leadership levels.

  • Non-linear and lateral career moves are harder to evaluate, with Grant Studio still refining assessments for such paths.

  • Leadership transitions require additional training beyond readiness indicated by the career path evaluations.

  • Client evaluations focus on studio-wide feedback rather than individual designers to respect client time and relationships.

  • The system fosters a sense of safety and clarity around career progression, aiding retention and alignment with company goals.

  • Challenges include varying quality of feedback and limited attention to role adjustments for accessibility or disabilities.

Notable Quotes

"Even before adding ambiguity, design roles like lead designer can mean very different things across places."

"Design is collaborative, making it hard to evaluate a single design output."

"We developed a career path that defines expectations to make evaluations fair and consistent across roles."

"Continuous feedback after each project happens anonymously and is goal-focused to improve relevance."

"The career path is a weighted system where roles emphasize different categories like craft or client."

"We chose a Google Sheet so we know what’s going on under the hood and can quickly make adjustments."

"The career path has helped us improve retention, staffing, and mentoring within the studio."

"People see either all their accomplishments or all their gaps—it’s not a race to fill the pages."

"Non-linear careers are tough to manage, and we’re still figuring out how to evaluate those paths."

"We haven’t considered adjustments for accessibility yet, but it’s an important future area."

Ask the Rosenbot
Aiyana Bodi
Three Key Climate Initiatives and How You Can Help
2024 • Climate UX Interest Group (Rosenfeld Community)
Dr. Jamika D. Burge
Bridge Building across Research Disciplines (Videoconference)
2021 • Advancing Research Community
Terry Buckman
Wargaming (An Introduction) (Videoconference)
2023 • Enterprise Community
John Maeda
About Design Organizations (Videoconference)
2019 • DesignOps Community
Megan Nipe
Human-Centered Design for Engagement: Maturing from Newsletterville to Personalized, One-to-One Messaging
2021 • Civic Design 2021
Gold
Simon Wardley
Maps and Topographical Intelligence (Videoconference)
2019 • Enterprise Community
Weidan Li
[Case Study] Qualitative synthesis with ChatGPT: Better or worse than human intelligence?
2024 • Designing with AI 2024
Gold
JD Buckley
Communicating the ROI of UX within a large enterprise and out on the streets
2018 • Enterprise Experience 2018
Gold
Shaping design, designers and teams
2018 • DesignOps Summit 2018
Gold
Feleesha Sterling
Building a Rapid Research Program (Videoconference)
2023 • Enterprise Community
Taylor Jennings
Repository Retrospective: Learnings from Introducing a Central Place for UX Research
2022 • Advancing Research 2022
Gold
Bria Alexander
Reflect and Chart Forward
2021 • Civic Design 2021
Gold
Greg Petroff
Design is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
2021 • Design at Scale 2021
Gold
Janelle Estes
UX Research Trends (Videoconference)
2021 • Advancing Research Community
Jennifer Bolduc
What's involved with getting people back to work?: A panel discussion (Videoconference)
2021 • DesignOps Community
Billy Carlson
Tips to Utilize Wireframes to Tell an Effective Product Story
2023 • Enterprise UX 2023
Gold

More Videos

Jemma Ahmed

"Holding on too tightly to insights and controlling data flows can make research teams irrelevant."

Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher Nash

Democratization: Working with it, not against it [Advancing Research Community Workshop Series]

July 24, 2024

Nina Jurcic

"The work of the design system is constant change management, raising awareness, and fostering common language."

Nina Jurcic

The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change

October 3, 2023

Nathan Curtis

"The design system is a living, breathing thing that evolves constantly because you’re constantly learning and responding to needs."

Nathan Curtis Nalini P. Kotamraju Jack Moffett Dawn Ressel

Discussion

June 9, 2016

Saara Kamppari-Miller

"When tactical metrics end up on the left side and KPIs on the right side of the compass, that signals we need a longer conversation about what we measure."

Saara Kamppari-Miller Nicole Bergstrom Shashi Jain

Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”

November 13, 2024

Malini Rao

"It’s really hard to make changes to these systems because it’s risk-ridden and a major undertaking."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021

Mackenzie Cockram

"Stakeholders often have strong opinions; our job is to back decisions with solid, evidence-based data."

Mackenzie Cockram Sara Branco Cunha Ian Franklin

Integrating Qualitative and Quantitative Research from Discovery to Live

December 16, 2022

Bria Alexander

"There is no need to take notes because we have sketch note makers capturing the sessions for you."

Bria Alexander

Opening Remarks

June 9, 2021

Jackie Ho

"If the investment isn’t paying out, we actually recommend that you divert that investment to another area."

Jackie Ho

Lead Effectively While Preserving Team Autonomy with Growth Boards

January 8, 2024

Dan Hill

"Uber incentivizes drivers to be on the road waiting for passengers, which adds to congestion."

Dan Hill

Designing for the infrastructures of everyday life

June 4, 2024