2022-23

Screenshot 2024-03-29 at 05.36.54.png

Overview

For users who want augmented reality interfaces without HMD’s. An augmented reality device that takes computing beyond 2D by leveraging CNNs, Nerfs and Anamorphism. Without the isolation or nausea associated with head-mounted displays (HMDs).

Designed with a focus on marginalised user groups in frontier markets.

Tags Product Design, Interaction Design, Information System
Research methods User Interviews, Ethnography, Usage Data Analysis, Case Study Research
Primary tools Madmapper, NeRF’s, Python, Blender and Adobe suite

Insights

Novel views can be synthesised for a scene using NERF’s. Different POV’s used in conjunction with machine vision can be used to generate 3D versions of the scene.

Mature technologies can be laterally connected for new product experiences.

User Research / Why

Immersive content enhances information absorption. By expanding the dimensions of a piece of content, more information can be conveyed while reducing system entropy. However, delivering information in this format necessitates new hardware capabilities.

In conversations with individuals from various backgrounds and through self-testing, the limitations of AR/VR/XR hardware became evident, particularly in densely populated countries like India and Indonesia. Shared living spaces pose a challenge as current devices only cater to one user at a time, and lower-priced HMDs contribute to motion sickness due to their displays.

Spatial augmented reality (SAR) attempted to address these issues 12 years ago by projecting onto indoor environment walls. However, technical constraints limited projection to 2D content and the projections lacked dynamic responsiveness to space and occupants. By integrating anamorphism with widely understood machine learning features like plane, object recognition, and NeRFs, SAR can be designed to overcome these limitations and function intuitively.

Screenshot 2024-02-02 at 12.31.06.png