Web Gestural Controller

Handmate MIDI is a browser-based MIDI controller which allows you to control MIDI using your hand gestures, detected via Google MediaPipe's Hand model. Below is a YouTube demo:

Handmate Effects is a browser-based audio effects controller which allows you to control audio effects on your own audio input and audio files using your hand gestures, detected via Google MediaPipe's Hand model. Below is a YouTube demo:

TouchDesigner

MaxMSP - Motion Analysis

MaxMSP - DSP Tools

Machine Learning Resources

For musical and artistic creative application, Rebecca Fiebrink's Wekinator is recommended as a first step in implementing ML. This is great for bypassing the usual painful and predictable mapping required in traditional interactive design. She also provides a free course on Wekinator and ML generally.

I found that the best (and free!) way to learn more deeply about ML and implementing Tensorflow is starting with the Google Colab crash course.