Sponsored Research
2016 to 2017


This research project explored how immersive design tools may impact the future of design and creative work. Insights from fieldwork with designers and engineers at Steelcase inspired a series of design fiction scenarios in room-scale VR. We focused in particular on exploring how immersive interfaces could reshape practices of ideation, sketching, modeling, annotation, and prototype-review. We developed a methodology we call immersive design fiction to situate fictional embodied experiences in VR. As speculative interaction designers, immersive design fiction enables us to go beyond the simple prototyping of interfaces to also model the interaction rituals and surrounding social worlds that might envelope these experiences.

VR Experience Breakdown:

The experience begins with an immersive design prompt set in an Insight Space - a virtual geodesic dome populated with inspirational media and research insights.

We developed a sketching environment we called Playground specifically tailored to support ideation during the initial phases of concept development.

We also designed an experience called Model Manipulation, which enabled us to explore speculative interfaces and social rituals for manipulation, annotation, and collaboration. Of particular interest here was our ability to represent NPCs as social actors within this world. As a design "fiction" this project was quite unique in that it included fully operational UI features in a world occupied by non-player characters (NPC)s. VR users can watch NPC characters demonstrate unfamiliar modes of use before handing over the controls to the user to try it out themselves. And beyond demonstrating tools, NPCs were also able to model new speculative forms of social interaction.

We made the strategic choice to fashion NPCs as simple hands (represented by tool tips) and eyes (represented by a colored binocular shape). The rationale for this choice was so that our NPC-action recording tool could drive NPC actions without us also having to resort to a full Mo-cap solution. This decision enabled us to be nimble and continue to adapt the immersive design fiction as the NPC narrative scenarios informed our design process.

For the final scene, we developed a scene that depicts the final review of a chair model. The chair presented mapped onto a trackable chair in physical space, so that when a user in VR touches the virtual chair they also feel the physical analogue. Accordingly, one can sit in the physical chair and roll or rotate while simultaneously seeing the virtual model respond accordingly.

When the user sits, they have the opportunity to interact with interface elements that move with the chair, an environment that we referred to as an ‘interface cocoon.’



Scott Fisher - Producer/Director, USC Mobile and Environmental Media Lab

Jen Stein - Development Producer

Joshua McVeigh-Schultz - Project Director

Perry Hoberman - Art Director

Max Kreminski - Designer & Developer

Michael Kozlowski - Designer & Developer

Maryyann Landlord - Modeler

Julian Ceipek - Designer & Technical Adviser

Keshav Prasad - Junior Designer

Jesse Holcomb - Voice of Design Narrator

Zachary Barton - Voice of Ada

JJ Dunlap - Voice of Rafael

Biayna Bogosian - 3D Printing Engineer

Brady Thomas - 3D Print Designer