Learning experience for Autistic Adults

Learning experience for Autistic Adults

Learning experience for Autistic Adults

Creating an accessible, inclusive learning experience for Luv Michael's Neurodivergent employees to learn and practice hygiene practices in their kitchens.

Creating an accessible, inclusive learning experience for Luv Michael's Neurodivergent employees to learn and practice hygiene practices in their kitchens.

Creating an accessible, inclusive learning experience for Luv Michael's Neurodivergent employees to learn and practice hygiene practices in their kitchens.

CLIENT

CLIENT

NASA, ARISA Labs
(NYU School Project)


NASA, ARISA Labs
(NYU School Project)

NASA, ARISA Labs
(NYU School Project)

MY ROLE & TOOLS

MY ROLE & TOOLS

User Research
UI Design - Figma, WAVE Accessibility checker

User Research
UI Design - Figma, WAVE Accessibility checker

TEAM & DURATION

TEAM & DURATION

3 designers under the guidance of Regine Gilbert
4 Weeks

3 designers under the guidance of Regine Gilbert
4 Weeks

Design an accessible map on the Eclipse Soundscape website (desktop version) for participants to view eclipse information.

Design an accessible map on the Eclipse Soundscape website (desktop version) for participants to view eclipse information.

Design an accessible map on the Eclipse Soundscape website (desktop version) for participants to view eclipse information.

The challenge

The challenge

The Safe Serv Handbook presents accessibility challenges for adults with autism (working at Luv Michael) at a preschool to kindergarten reading level. The current format fails to address their unique needs, impeding comprehension and use of essential safety information.

The Safe Serv Handbook presents accessibility challenges for adults with autism (working at Luv Michael) at a preschool to kindergarten reading level. The current format fails to address their unique needs, impeding comprehension and use of essential safety information.

The result

The result

Understanding the landscape

Understanding the landscape

Luv Michael has adult autistic employees who need an inclusive tool to learn about hygiene practices in the kitchen

Luv Michael has adult autistic employees who need an inclusive tool to learn about hygiene practices in the kitchen

Luv Michael has adult autistic employees who need an inclusive tool to learn about hygiene practices in the kitchen

Employees at Luv Michael had instructors training them in person, having an inclusive, interactive learning tool to reinforce/revise what they've learnt in these trainings about hygiene practices in the kitchen could be more effective.

Employees at Luv Michael had instructors training them in person, having an inclusive, interactive learning tool to reinforce/revise what they've learnt in these trainings about hygiene practices in the kitchen could be more effective.

To understand our users, how they learn, and work in the kitchen, we made a few client visits

To understand our users, how they learn, and work in the kitchen, we made a few client visits

To understand our users, how they learn, and work in the kitchen, we made a few client visits

Employees at Luv Michael had instructors training them in person, having an inclusive, interactive learning tool to reinforce/revise what they've learnt in these trainings about hygiene practices in the kitchen could be more effective.

Employees at Luv Michael had instructors training them in person, having an inclusive, interactive learning tool to reinforce/revise what they've learnt in these trainings about hygiene practices in the kitchen could be more effective.

Employees at Luv Michael had instructors training them in person, having an inclusive, interactive learning tool to reinforce/revise what they've learnt in these trainings about hygiene practices in the kitchen could be more effective.

So, what is needed?

So, what is needed?

So, what is needed?

Most employees understand kindergarten-elementary reading levels.

Some employees are non-verbal. Visuals, games, and hands-on-activities are often helpful.

Visuals accompanied with audio is an effective approach.

Words of appreciation and motivation constantly are useful.

They all have their own phones and like to play games.

Customizable learning paths.

Most employees understand kindergarten-elementary reading levels.

Some employees are non-verbal. Visuals, games, and hands-on-activities are often helpful.

Visuals accompanied with audio is an effective approach.

Words of appreciation and motivation constantly are useful.

They all have their own phones and like to play games.

Customizable learning paths.

Research and Brainstorming

Research and Brainstorming

Research and Brainstorming

Current Luv Michael's curriculum

Current Luv Michael's curriculum

We took a look at Luv Michael's current curriculum called Service Safe to understand their material and how trainings are being carried out at Luv Michael

We took a look at Luv Michael's current curriculum called Service Safe to understand their material and how trainings are being carried out at Luv Michael

Available tools/approaches in the market for Autistic People

Available tools/approaches in the market for Autistic People

Most available learning tools available in the market are for autistic children, very few are available for autistic adults.

Many studies suggest that Augmented Reality and Autism work well together.

Most available learning tools available in the market are for autistic children, very few are available for autistic adults.

Many studies suggest that Augmented Reality and Autism work well together.

Discussed our ideas with our Luv Michael POC

Discussed our ideas with our Luv Michael POC

Suggested using on of the following:

an interactive website game/video sessions

a tactile game

an Augmented Reality tool

Our client though the first two ideas were redundant since they already use those approaches. They wanted us to test if AR would work.

Suggested using on of the following:

an interactive website game/video sessions

a tactile game

an Augmented Reality tool

Our client though the first two ideas were redundant since they already use those approaches. They wanted us to test if AR would work.

User Testing with AR

User Testing with AR

User Testing with AR

To understand if AR is a potential solution, we wanted to see how Luv Michael employees interact with it

To understand if AR is a potential solution, we wanted to see how Luv Michael employees interact with it

To understand if AR is a potential solution, we wanted to see how Luv Michael employees interact with it

We did another client visit having some of the employees try using the below AR applications that we found online

We did another client visit having some of the employees try using the below AR applications that we found online

Chalk

Chalk

AR Basketball

AR Basketball

AR Apps

AR Apps

We took notes on how the employees are interacting with their phones while using the application, and asked them questions on what they liked about each application.

- Most of them said that they like watching things move when they interact with the screen(such as seeing the basketball move).

- The primary instructor at Luv Michael said that AR could be a promising approach and wants to give it a shot based on the user testing.

We took notes on how the employees are interacting with their phones while using the application, and asked them questions on what they liked about each application.

- Most of them said that they like watching things move when they interact with the screen(such as seeing the basketball move).

- The primary instructor at Luv Michael said that AR could be a promising approach and wants to give it a shot based on the user testing.

Designing the Experience

Designing the Experience

Designing the Experience

Hierarchical Task Analysis(HTA) is a crucial step when developing assistive technology

Hierarchical Task Analysis(HTA) is a crucial step when developing assistive technology

Hierarchical Task Analysis(HTA) is a crucial step when developing assistive technology

We did the below Hierarchical Task Analysis to understand the step-by-step process of how the user would use the product. This helped us anticipate different challenges they would face in each step and address the same.

We did the below Hierarchical Task Analysis to understand the step-by-step process of how the user would use the product. This helped us anticipate different challenges they would face in each step and address the same.

Building Hygiene example scenarios and wireframes to make on Snapchat's Lens Studio

Building Hygiene example scenarios and wireframes to make on Snapchat's Lens Studio

Building Hygiene example scenarios and wireframes to make on Snapchat's Lens Studio

Crafting the UI Kit

Crafting the UI Kit

Crafting the UI Kit

First AR Prototype

First AR Prototype

First AR Prototype

We used Snapchat's Lens Studio to build our initial prototypes to be able to test out with the employees from Luv Michael to move to the next iteration.
Each scenario has readable text accompanied with slow audio and visuals while adhering to WCAG accessibility guidelines.

We used Snapchat's Lens Studio to build our initial prototypes to be able to test out with the employees from Luv Michael to move to the next iteration.
Each scenario has readable text accompanied with slow audio and visuals while adhering to WCAG accessibility guidelines.

Sample scenario #1 :
Which sink do we wash our hands in?

Sample scenario #1 :
Which sink do we wash our hands in?

Sample scenario #1 :
Which sink do we wash our hands in?

The first scenario tests the difference between the Hand washing sink and Kitchen sink at Luv Michael.

The first scenario tests the difference between the Hand washing sink and Kitchen sink at Luv Michael.

The first scenario tests the difference between the Hand washing sink and Kitchen sink at Luv Michael.

Uh-oh! Looks like there's something on the floor

Uh-oh! Looks like there's something on the floor

Uh-oh! Looks like there's something on the floor

After the First Scenario, the AR would ask the user to tilt their phone towards the floor and say, 'Uh-oh! Looks like there's something on the floor'. When they tilt the floor, they would see some virtual granola on the phone. The Avatar gives them an option to pick it up and the next scenario pops up after this action.
(We currently do not have this part prototyped.)

After the First Scenario, the AR would ask the user to tilt their phone towards the floor and say, 'Uh-oh! Looks like there's something on the floor'. When they tilt the floor, they would see some virtual granola on the phone. The Avatar gives them an option to pick it up and the next scenario pops up after this action.
(We currently do not have this part prototyped.)

After the First Scenario, the AR would ask the user to tilt their phone towards the floor and say, 'Uh-oh! Looks like there's something on the floor'. When they tilt the floor, they would see some virtual granola on the phone. The Avatar gives them an option to pick it up and the next scenario pops up after this action.
(We currently do not have this part prototyped.)

Sample Scenario #2:
After picking up something off the floor, what next?

Sample Scenario #2:
After picking up something off the floor, what next?

Sample Scenario #2:
After picking up something off the floor, what next?

The user is then prompted to select the right option after picking up something off the floor, which would be to wash their hands.

The user is then prompted to select the right option after picking up something off the floor, which would be to wash their hands.

The user is then prompted to select the right option after picking up something off the floor, which would be to wash their hands.

Next Steps

Next Steps

Next Steps

Going forward, we would like to:
1. Conduct usability testing with the current protoype with Luv Michael employees to note things that work and pain points.
2. Prepare detailed user flows of different types of scenarios.
3. Developing the AR experience on Unity using an iterative approach.

Going forward, we would like to:
1. Conduct usability testing with the current protoype with Luv Michael employees to note things that work and pain points.
2. Prepare detailed user flows of different types of scenarios.
3. Developing the AR experience on Unity using an iterative approach.

All rights reserved © 2024

All rights reserved © 2024

All rights reserved © 2024