Musica Univasalis

Musica Univasalis

Musica Univasalis

2023.3 - 2023.9

Role

Gameplay Engineer, Game Designer

Gameplay Engineer, Game Designer

Awards and honor

Linz Ars Electronica 2023 Finalist

Linz Ars Electronica 2023 Finalist

Introduction

Musica Universalis is an interactive AR art installation inspired by the ancient Greek concept of ‘Music of the Spheres.’ In this philosophy, celestial movements create music, forming a universal harmony. Using Microsoft HoloLens2, this work bring this idea to life by allowing participants to interact with planets using natural hand gestures. In their default state, the planets follow their orbits while collectively playing Debussy’s ‘Moonlight.’ However, when a participant manipulates a planet—pinching, pushing, or dragging it—the music dynamically shifts, producing echoes and altering the harmony. The closer a player brings a planet, the more pronounced the sound variations become, creating a deeply immersive experience that bridges music, space, and touch.

Musica Universalis is an interactive AR art installation inspired by the ancient Greek concept of ‘Music of the Spheres.’ In this philosophy, celestial movements create music, forming a universal harmony. Using Microsoft HoloLens2, this work bring this idea to life by allowing participants to interact with planets using natural hand gestures. In their default state, the planets follow their orbits while collectively playing Debussy’s ‘Moonlight.’ However, when a participant manipulates a planet—pinching, pushing, or dragging it—the music dynamically shifts, producing echoes and altering the harmony. The closer a player brings a planet, the more pronounced the sound variations become, creating a deeply immersive experience that bridges music, space, and touch.

Contribution

  • Used Unity and MRTK’s hand interaction module for gesture-based interaction with virtual planets

  • Integrated Vuforia for real-world object localization, enhancing AR overlays via AR glasses

  • Deployed assets to Hololens 2, merging celestial movements and music for an immersive cosmic experience

  • Used Unity and MRTK’s hand interaction module for gesture-based interaction with virtual planets

  • Integrated Vuforia for real-world object localization, enhancing AR overlays via AR glasses

  • Deployed assets to Hololens 2, merging celestial movements and music for an immersive cosmic experience

  • Used Unity and MRTK’s hand interaction module for gesture-based interaction with virtual planets

  • Integrated Vuforia for real-world object localization, enhancing AR overlays via AR glasses

  • Deployed assets to Hololens 2, merging celestial movements and music for an immersive cosmic experience

Contact Info

liwenxuan0825@gmail.com

+1 2138069077

Social Media

WENXUAN LI

Contact Info

liwenxuan0825@gmail.com

+1 2138069077

Social Media

WENXUAN LI

Contact Info

liwenxuan0825@gmail.com

+1 2138069077

Social Media

WENXUAN LI