Making Music Education Accessible with SymphoMe

Inspired by the gamified approach of language apps like Duolingo, Ifeanyichukwu Ezinmadu founded SymphoMe and its app that makes music education more intuitive, expressive and scalable.

Their mission? To build an AI driven system that can understand music performance in realtime, allowing learners to receive feedback not just through audio, but also through highly accurate visual cues and body language recognition.

The Challenge

Traditional methods of teaching music rely on static videos or text-heavy tutorials. But real learning happens when feedback is immediate and multimodal. SymphoMe wanted to capture the expressive elements of human performance (especially face and finger movements) using motion capture and AI.

A major technical challenge was accurately tracking individual finger joints. Off-the-shelf gloves like those from StretchSense and Manus provided a solid starting point, but the StudioT3D team took it a step further.

The Solution

Working from StudioT3D (part of the Advanced Media Production Network), a large LED virtual production volume and motion capture stage in London, the team used OptiTrack cameras with custom markersets to track each finger joint in detail. Cameras were repositioned closer to the performer’s hands to enhance precision and then cleaned mocap data was retargeted to a 3D model, creating frame-accurate performance visuals.

The Result

By replacing the need to manually record thousands of video performances, SymphoMe hopes to build a workflow that is scalable, repeatable and machine-readable.

The team will continue testing and refining with this strong technical foundation to support ongoing AI development in their mission to build a new kind of music tutor - one that responds to learners in real time.

The Feedback

"It’s great to be able to collaborate with Innovation Funding on this, to be able to try, as a feasibility study, that our crazy idea is actually possible."

– Ifeanyichukwu Ezinmadu, Founder and CEO of SymphoMe

Are you looking for funding for your R&D project? Let us know here. Interested in learning more about how motion capture can be used? Talk to us. Visit studiot3d.com or mail info@studiot3d.com.

Find out more about SymphoMe at symphome.com.