The Theater
A VR interactive theatre play project, blends traditional Chinese theatre aesthetics with modern machinery design, showcasing the mix of modern peroformance and advanced mocap technology and experimental VR interactive methods, to explore themes of individualism and collectivism.
Playthrough Video
Synopsis
The Theater is an immersive VR experience that bridges performance and interaction through advanced AI motion capture and finger-tracking technology, allowing controller-free engagement. The work presents two contrasting virtual worlds: one embodying Eastern collectivism and the other Western individualism. Each world unfolds as a living stage, offering performances that players can actively participate in, shaping their experiences through movement and gesture. By immersing the audience in these dual narratives, the piece invites reflection on the interplay between personal identity and communal belonging, exploring how these cultural philosophies influence our roles and relationships in society.
CHOREGRAPHY & MOTION CAPTURES
Players experience mesmerizing performances blending AI motion capture (Qian Mian) and OptiTrack, capturing the artistry of professional dancers. AI mocap ensures dancers can perform freely in their most comfortable space, while OptiTrack provides high-precision tracking for multi-performer interactions, creating a dynamic and immersive choreography.
HAND TRACKING & VIRTUAL AVATAR
The game integrates an open-source plugin by Jason Meisel, leveraging the Quest HMD's highly accurate hand-tracking feature to enhance immersion. This system is attached to an IK rig, providing players with a full-body avatar that moves naturally in response to their gestures. Hand pose recognition also plays a key role in navigation, creating a seamless and intuitive interactive experience.
FASHION IN REALTIME
The costumes in the game are crafted by talented fashion designers using Marvelous Designer, enhanced by Unreal Engine’s latest Chaos Cloth system for real-time, physically accurate fabric simulation. AI-generated 3D modeling technology is also incorporated to create intricate, avant-garde ornaments and accessories, pushing the boundaries of digital fashion design.
CREDITS:
Co Directors: John Luo, Yingru Huang
Screenplay Co Director: Lois He
Choreography Director: Yingru Huang
Game Developer: John Luo, Alan Ren
Tech & 3D Artist: John Luo, Kano Tao, Yi Wang
Fashion Designer: Maggie Zhou, Yoyo Shang
Motion Capture Performer: Yingru Huang, Tanya Xu, Wisdom Zhang, Audrey Chou, Chienn Tai, Siyu Duan, Karin K. Jensen, Kylie Boyd, Kamala Fifield, Addy Bradley, Kai Hannigan
Music Composer: Yingru Huang, Alexia Diaz, Chienn Tai
Fashion Consultant: Elena Liu, Annie Xing, Laurel Fang
Hand Tracking Template: Jason Meisel