MARY AND THE MONSTER

Augmented Reality Theatrical Experience

ROLE:
Director

DURATION:
1 Year

MEDIUM:
Shared Augmented Reality

TOOLS:
Photoshop, Cinema 4D, Sketchup Unity, Unreal Engine

AWARDS:
Cannes XR, Tribeca Film Festival, Epic Megagrant Recipient

PARTNERS:
NYU, Magic Leap, Epic Games

SUMMARY

Mary, a 20-minute AR experience by NYU Future Reality Lab and Magic Leap, immerses groups of 15 in an animated performance that tells the story of Frankenstein's inception from Mary Shelley's perspective.

APPROACH

I spearheaded the "Mary" project from its ideation to its completion, successfully transforming an ambitious concept into a powerful immersive augmented reality experience:

Conceived the original vision and provided art direction.
Collaborated with writers, technical directors, and producers to develop the project from prototypes to final deliverable.
Directed the motion capture performances of three actors, ensuring their movements and emotions resonated within the virtual environment.
Oversaw a multi-talented team of engineers, artists, and developers, guiding them to harness their collective skills and foster a collaborative environment to realize our shared vision for the project.

RESULTS

"Mary" was initially showcased as a technical demonstration at the Immersive Pavilion of SIGGRAPH 2019, followed by its premiere at the prestigious Tribeca Immersive and Cannes XR festivals in 2020.

MARY AT SIGGRAPH VIDEO

AR AUDIENCE EXPERIENCE

The initial demo of "Mary" at SIGGRAPH was a tabletop miniature for a small audience of 6, using Magic Leap headsets.

For the subsequent premieres at Tribeca and Cannes, we planned to elevate the experience to a new level, transforming the miniature tableau into life-sized characters and scenery to create an even more immersive and engaging spectacle.

Concept image for Tribeca/Cannes premiere

TONE AND ATMOSPHERE

I envisioned "Mary" as a hauntingly classic gothic experience with whimsical and playful elements, inspired by Disney's Haunted Mansion and The Phantom of the Opera musical.

My team and I researched early 19th-century England to create an authentic historical foundation, then gave creativity free rein in design, resulting in concept images brimming with neon lights, vibrant colors, and ornate candelabras.

The standout character design exudes strong, unforgettable personalities, with every detail meticulously crafted to ensure each character brings unique charm to the narrative.

Original Concept Illustration by Kris Layng

Initial 3D Mockup of Byron's House by Kris Layng

First 3D Mockup of Victor's Lab by Kris Layng

Character Inspiration Board and Sketches by Kris Layng and Kat Jeffery

Character Design by Kris Layng, Kat Jeffery, and Chris Muller

MARY UNREAL ENGINE

In fall 2020, I won an Epic Mega Grant, which empowered me to elevate Mary's visual fidelity by transitioning from Unity to Unreal Engine.

I hired a talented technical artist, lighting designer, and cinematographer to revamp everything from character models to graphics and animations for a short film of Mary.

The result is a stunningly reimagined Mary with significantly enhanced visual richness and an enchanting aesthetic that further deepens the audience's immersion into the narrative.