Immersive Synthetic Memories (2024)

The Immersive Synthetic Memories project is a collaboration with the Synthetic Memories project by Digital Data Streamers.    A Synthetic Memory is a digitally reconstructed representation of a personal memory created with Generative Artificial Intelligence (GEN-AI) technologies. It recreates a past visual experience that might have faded, changed, or been forgotten over time. Unlike our natural memories, which are created and stored in the human brain, Synthetic Memories are produced by algorithms. These algorithms interpret descriptions of personal experiences and turn them into images and short videos.  The collaboration explores the extension of synthetic memories into immersive space.  

The process begins with a one-on-one interview, where participants describe a vivid memory in detail. Using AI-generated visual prompts, these recollections are iteratively refined until they align closely with the participant’s perception. Once finalized, the images are transformed into 3D stereoscopic 180° VR environments, allowing users to step inside their memories and engage with them in an emotionally resonant and immersive way.

The project employs two distinct visualization methods:

- 180° VR rendering, which creates spatially rich environments that surround the participant.

- Gaussian splatting, a novel AI-driven technique that produces fluid, volumetric reconstructions of memory spaces.

By redefining memory preservation through AI and immersive media, Synthetic Memories prompts critical discussions about how emerging technologies shape personal and collective recollections. The project offers a groundbreaking approach to archiving experiences, challenging traditional documentation methods and expanding the possibilities of storytelling, cultural memory, and digital heritage in the age of AI-driven creativity. 

Project Team: 

USC Mobile & Environmental Media Lab: 

• Zeynep Abes
• Scott Fisher
• Spencer Lin
• Stanley Lin

IML475 Spatial Imaging for XR class fa'24:

Isa Analo, Jinglin Jingan, Erin Lee, Zitong Wang, Julianne Wong, Coco Xiong, and Xinghan Zhuang.

Domestic Data Streamers:

• Pau Aleikum Garcia
• Airí Dordas