This is a demo video showing a hand-controlled arpeggiator, drum machine, and audio reactive visualizer

Runs in real-time on the web, using a laptop webcam

Created with threejs, rosebud AI, mediapipe computer vision, and tone.js

Work in progress live demo: https://rosebud.ai/p/f8f8cd80-1f68-466a-9da2-09cc0c354f45

Next I want to add new synth sounds and find an easy gesture to change the drum patterns

Any feedback would be appreciated!