In this masters level course, our team focused on optimizing the Advanced Cardiovascular Life Support (ACLS) VR training debriefing sessions at the University of Michigan Medicine. The primary objective was to enhance the overall learning experience by simplifying and refining the debriefing process for both trainees and instructors. The project scope includes a user-centric design approach and a robust feedback system for continuous improvement. Through these initiatives, my team and I aimed to create a more user-friendly and efficient debriefing process and foster a positive learning environment.

mTeam Reflect

Year

Aug '23 - Dec '23

Project

SI 582: Introduction to Interaction Design

Tools

Figma, FigJam

Roles & Responsibilities

  • User research

  • Research synthesis

  • Ideation sketches

  • Design development

  • User flows

  • Wireframing & Prototyping

  • Usability Testing

The Team

  • Aleena Qaiser: Ideation and prototyping

  • Jinnan Chen: Research and prototyping

  • David Cox: Brainstorming & Research

  • Vivian Gao: Research

The Team

  • Aleena Qaiser: Ideation and prototyping

  • Jinnan Chen: Research and prototyping

  • David Cox: Brainstorming & Research

  • Vivian Gao: Research

The Client

  • Michigan Medicine

The Challenge

Medical trainees at University of Michigan at Advanced Cardiovascular Life Support (ACLS) training need a better feedback system on their simulation performances to improve their skill set and pass certifications.

A need for enhanced feedback system

Keep track of all training sessions

The Context

Medical trainees start their simulation in the simulation room as shown in the top image on the right. The simulation lasts for around 15 minutes, after which they have a debrief session in the debrief room where the instructor plays the recording and comments on their performance. This lasts about 5-10 minutes.

  • Simulation Room

  • Observation Room (for instructors)

  • Debriefing Room

The Challenge

University of Michigan medical trainees, performing Advanced Cardiovascular Life Support (ACLS) training, need a better feedback system for their simulation performances to improve their skill set and pass certifications. The debriefing sessions are quick and short with no way for instructors, nor trainees, to keep a track of their records.

A need for enhanced feedback system

Keep track of all training sessions

The Context

Medical trainees start their simulation training in the simulation room which lasts for around 15 minutes, after which they have a debrief session in the debrief room where the instructor plays the recording of their session and comments on their performance. This lasts about 5-10 minutes.

  • Simulation Room

  • Observation Room (for instructors)

  • Debriefing Room

The Solution

Our solution is the mTeam Reflect - Creating medical leaders, one debrief at a time.


We aim to transform debriefing data into personalized learning insights to enhance the development trajectory and lifesaving skills of each medical trainee in an efficient, scalable manner.

Our solution is the mTeam Reflect - Creating medical leaders, one debrief at a time.


We aim to transform debriefing data into personalized learning insights to enhance the development trajectory and lifesaving skills of each medical trainee in an efficient, scalable manner.

Our solution is the mTeam Reflect - Creating medical leaders, one debrief at a time.


We aim to transform debriefing data into personalized learning insights to enhance the development trajectory and lifesaving skills of each medical trainee in an efficient, scalable manner.

Target Audience

Instructors: Keep a record of all trainees' performances and review student feedback.

Instructors: Keep a record of all trainees' performances and review student feedback.

Trainees: Keep a record of their performance to go back and learn from their mistakes.

Trainees: Keep a record of their performance to go back and learn from their mistakes.

Target Audience

Instructors: Keep a record of all trainees' performances and review student feedback.

Trainees: Keep a record of their performance to go back and learn from their mistakes.

Target Audience

Instructors: Keep a record of all trainees' performances and review student feedback.

Trainees: Keep a record of their performance to go back and learn from their mistakes.

Interview Findings

We engaged in insightful qualitative interviews with four different ACLS trainees, two instructors, and the mTeam project director. These discussions helped guide us to prioritize essential features for an impactful solution.

We engaged in insightful interviews with four different ACLS trainees, two instructors, and mTeam project director. These discussions provided a comprehensive understanding of the debriefing session and perspectives from both sides, guiding us to prioritize essential features for an impactful solution.

“It is important to tailor the feedback system to our specific learner population and personas. “

- Instructor

“Sometimes it’s almost too much training and there tends to be more questions than there is time to ask them. “

- Student

“Timeframes are frequently referenced, underpinning the narrative's context. “

- Student

Personas

We created two primary and two secondary personas: medical students and instructors.


Creating personas helped us empathize with our users and see the problem from their perspective. It also helped us generate ideas and solutions that were tailored to their needs and goals.

We created two primary and two secondary personas: medical students and instructors.


Creating personas helped us empathize with our users and see the problem from their perspective. It also helped us generate ideas and solutions that were tailored to their needs and goals.

We created two primary and two secondary personas: medical students and instructors.


Creating personas helped us empathize with our users and see the problem from their perspective. It also helped us generate ideas and solutions that were tailored to their needs and goals.

Tools Ideation

Ideation and Design

The simulation takes place in VR. The photo shows the headset that the trainees wear.

The simulation takes place in VR. The photo shows the headset that the trainees wear during the session.

We developed a total of nine tools with a primary emphasis on presenting performance metrics for various tasks conducted during the simulation. Our efforts encompassed a range of methods, including discussion forums, VR playbacks, emailed performance reports, and dashboard designs.

We developed a total of nine tools with a primary emphasis on presenting performance metrics for various tasks conducted during the simulation. Our efforts encompassed a range of methods, including discussion forums, VR playbacks, emailed performance reports, and dashboard designs.

QOC(Questions, Options, Criteria)

Based on the QOC Analysis, the Dashboard is the best tool to use to address our challenge.


The advantageous features of the Dashboard include:

  • Flexibility - it can present multiple sections that show the necessary information for an informed debrief session.

  • Accessible from any location and various devices.

  • Presenting holistic information for better debriefing session

  • Help participants to track their progress via better organized information data visualization, resulting in reduced cognitive load.

Based on the QOC Analysis, the Dashboard is the best tool to use to address our challenge.


The advantageous features of the Dashboard include:

  • Flexibility - it can present multiple sections that show the necessary information for an informed debrief session.

  • Accessible from any location and various devices.

  • Presenting holistic information for better debriefing session

  • Help participants to track their progress via better organized information data visualization, resulting in reduced cognitive load.

Based on the QOC Analysis, the Dashboard is the best tool to use to address our challenge.


The advantageous features of the Dashboard include:

  • Flexibility - it can present multiple sections that show the necessary information for an informed debrief session.

  • Accessible from any location and various devices.

  • Presenting holistic information for better debriefing session

  • Help participants to track their progress via better organized information data visualization, resulting in reduced cognitive load.

Experience Journey Map & Story Map

The experience journey map played a pivotal role in shaping our product development process by providing us with a comprehensive understanding of the user's needs, challenges, and expectations at each stage of their interaction with the product. This deep dive into the user experience allowed us to uncover insights that might have otherwise been overlooked.

The experience journey map played a pivotal role in shaping our product development process by providing us with a comprehensive understanding of the user's needs, challenges, and expectations at each stage of their interaction with the product. This deep dive into the user experience allowed us to uncover insights that might have otherwise been overlooked.

For the student, we took into account the logging in and onboarding before the start of the simulation, during debrief, and after debrief session where the student can leave the instructor feedback or ask for more help.

For the student, we took into account the logging in and onboarding before the start of the simulation, during debrief, and after debrief session where the student can leave the instructor feedback or ask for more help.

For the instructor, we designed the debriefing session and the summary dashboard to view the performance analytics for all teams.

For the instructor, we designed the debriefing session and the summary dashboard to view the performance analytics for all teams.

Experience Journey Map

Story Map


The blue dotted lines around the sticky notes highlight the instructor's actions.

User Flow Diagram

We identified three main stages of our design:

  • Pre-debrief: the onboarding for a new user before the simulation

  • During debrief: the dashboard

  • Post-debrief: summary dashboard of instructor and feedback from trainee


By mapping out the user flow, we gained a holistic view of the entire interaction, from the initial point of entry to the completion of tasks.

We identified three main stages of our design:

  • Pre-debrief: the onboarding for a new user before the simulation

  • During debrief: the dashboard

  • Post-debrief: summary dashboard of instructor and feedback from trainee


By mapping out the user flow, we gained a holistic view of the entire interaction, from the initial point of entry to the completion of tasks.

We identified three main stages of our design:

  • Pre-debrief: the onboarding for a new user before the simulation

  • During debrief: the dashboard

  • Post-debrief: summary dashboard of instructor and feedback from trainee


By mapping out the user flow, we gained a holistic view of the entire interaction, from the initial point of entry to the completion of tasks.

Low-fidelity Prototype

The low-fidelity prototype served as a testing ground, allowing us to observe how users navigated, concentrating on fundamental aspects, using basic layouts to gain a deeper understanding of the user flow and core functionalities to uncover additional needs and requirements.

The low-fidelity prototype served as a testing ground, allowing us to observe how users navigated, concentrating on fundamental aspects, using basic layouts to gain a deeper understanding of the user flow and core functionalities to uncover additional needs and requirements.

Mid-fidelity Prototype

After conducting usability tests with instructors and trainees at the University of Michigan hospital, we gained key insights which ultimately helped us refine our design and remove any irrelevant details.

We prioritized according to the user needs, since the debriefing session is very quick and short, the new design of the dashboard focuses on the video playback, allowing the user to compare it to the standard video via a toggle switch.

We prioritized according to the user needs, since the debriefing session is very quick and short, the new design of the dashboard focuses on the video playback, allowing the user to compare it to the standard video via a toggle switch.

The new design features everything on the dashboard to make it easily scannable.

The new design features everything on the dashboard to make it easily scannable.

Instead of opening a new page for extra details, the performance metrics are displayed on the right panel which is scrollable with collapsible components.

Instead of opening a new page for extra details, the performance metrics are displayed on the right panel which is scrollable with collapsible components.

Use the slider to compare the low-fidelity and mid-fidelity designs.

Action Timeline with Instructor Comments

The video playback features the instructor comments with timestamps. The red dots on the timeline highlight the critical mistakes made by the trainees which must be discussed in the debrief session. The dotted vertical lines represent the standard time for each stage which can be compared with the actual timeline of the time, represented by the horizontal blue lines. You can also identify which stage took longer by the highlighted red rectangles.


The icons are a very important feature of this. They represent the different actions that took place in the simulation. The UI of our design allows the user to understand each icon by hovering over it and understanding its meaning, as seen in the image below.

Action Timeline and Instructor Comments

The video playback features the instructor comments with timestamps. The red dots on the timeline highlight the critical mistakes made by the trainees which must be discussed in the debrief session. The dotted lines represent the standard time for each stage which can be compared with the actual timeline of the time represented by the blue lines. You can also identify which stage took longer by the highlighted red rectangles.

Action Timeline with Instructor Comments

The video playback features the instructor comments with timestamps. The red dots on the timeline highlight the critical mistakes made by the trainees which must be discussed in the debrief session. The dotted lines represent the standard time for each stage which can be compared with the actual timeline of the time, represented by the blue lines. You can also identify which stage took longer by the highlighted red rectangles.

The icons are a very important feature of this. They represent the different actions that took place in the simulation. The UI of our design allows the user to understand each icon by hovering over it and seeing its meaning, as seen in the photo below.

The icons are a very important feature of this. They represent the different actions that took place in the simulation. The UI of our design allows the user to understand each icon by hovering over it and understanding its meaning, as seen in the photo below.

Leaderboard

The leaderboard allows students and instructor to visualize the performance metrics. Only the top three teams are shown because through usability testing we discovered that since this is very competitive, instructors as well as students aim to be at the top.

Leaderboard

The leaderboard allows students and instructor to visualize the performance metrics. Only the top three teams are shown because through usability testing we discovered that since this is very competitive, instructors as well as students aim to be at the top.

Summary Dashboard

As instructors have multiple teams, this dashboard allows them to dive into team - specific data with more gradual detail

Prototype Walkthrough

This video highlights the walkthrough through of all three stages of our product.

Click here for the Figma prototype!

Branding

For the branding, we followed all guidelines of Michigan Medicine to ensure it follows their identity and blends in with their aesthetic.

Aa
Aa

IBM Plex Sans

ABCDEFGHIJKLMNOPQRSTUVWXYZ
012345

00274C

576E9A

DAEDFA

FFCB05

E9E9E9

989C97

Learning Outcomes

  • I acquired substantial expertise in information gathering through user interviews with instructors and medical trainees, aiming to comprehend their experiences and pain points within the current system. Employing this qualitative data, we crafted primary and secondary personas to cater to distinct user profiles.


  • I gained exposure and confidence in UI/UX methodologies, including QOCs (Questions, Options, Criteria), storyboarding, journey mapping, and story mapping. My team and I synthesized these insights into a comprehensive user flow diagram, serving as a foundational guide for developing the prototype screens.

Back to top

Back to top

Check out more projects!

Smart Storage Design

Developed display unit for Maybelline staff & customers

Smart Storage Design

Developed display unit for Maybelline staff & customers

Smart Storage Design

Developed display unit for Maybelline staff & customers

Detail

Climate Chaos

Designed an interactive climate crisis board game

Climate Chaos

Designed an interactive climate crisis board game

Climate Chaos

Designed an interactive climate crisis board game

Detail

Back to top

Check out more projects!

Climate Chaos

Designed an interactive climate crisis board game

Climate Chaos

Designed an interactive climate crisis board game

Climate Chaos

Designed an interactive climate crisis board game

Detail

Smart Storage Design

Developed display unit for Maybelline staff & customers

Smart Storage Design

Developed display unit for Maybelline staff & customers

Smart Storage Design

Developed display unit for Maybelline staff & customers

Detail

Let's connect!

aleenaq@umich.edu

© Copyright 2023. All Rights Reserved.

Made by

Aleena Qaiser

© Copyright 2023. All Rights Reserved.

Made by

Aleena Qaiser

© Copyright 2023. All Rights Reserved.

Made by

Aleena Qaiser