Amazon Fresh AR - Concept

*Not affiliated with Amazon. Consumer purchasing & employee packing XR Interface.

TEAM

Jessica Young (me)
Manini Banerjee

MY ROLE

UX Research
UIUX Design
AR Development

TIMEFRAME

Feb 2022 (2 week long project)

TOOLS

Figma
Blender
Unity [Vuforia Engine]
Meta Oculus Quest 2

Overview

Banana bread uses overripe bananas, Avocados you want to eat for breakfast tomorrow needs to be ripe and Tomatoes should not be bruised. Everyone has different preferences for how they like their produce. On top of individual preferences, nobody wants to use or eat produce that doesn’t meet their quality standards.

Project brief

✦ 2 week long design sprint.

✦ Project final for an Advanced CAD design class, where we were given full freedom to explore any program we wanted. My teammate and I chose to design within the world of AR!

Preliminary research

Why Amazon?

The various facets of the Amazon ecosystem were a great basis for our project to assimilate into its complex landscape.

Online produce shopping pain points

We sifted through hundreds of online reviews created by Amazon Fresh customers to pinpoint the biggest pain points when purchasing produce online.

Design objectives

From there, we decided on two main objectives:

Sustainability

To reduce food waste and making users more food conscious.

Convenience

To make food shopping and delivery more convenient.

Our Amazon Fresh AR system

We decided to focus on creating functioning interfaces for #4: the customer side, and #6: the employee side.

Final design

Consumer side (purchasing)

Consumers are no longer restricted to a screen to order food. Through voice activation, Alexa can place produce in AR in front of the user's eyes, regardless of location. The interface allows for the user to rotate and move the apple around the UI as if they were holding and interacting with it in store. For convenience, after one item is selected, Alexa recommends similar items.

Rotates a specific apple from the store using AR to determine desirability.

Drag produce to left for no, drag to right for yes.

Optimization screen: select similar apples to add to cart.

Employee side (packing)

On the employee side, orders would be sent straight to their AR glasses. The employee can track the specific produce through their AR glasses by using RFID technology. The list on the left can condense as to not obstruct the view. Once one type of produce has been found (ex. the apple), the next moves up in line (ex. the avocado). After all the items on the list have been added to the cart, the package is delivered to the customer.

The process is as follows:
1. Amazon sends order to employees.

2. Employee uses RFID + AR Glasses in store to find specific produce items.

3. Adds to physical cart.

4. Packages and ships/delivery stage.