Create your own musical instrument with custom gesture control

This will be a hands-on workshop during which we will build a digital musical instrument controlled by personalised gestures.

We will make a standalone desktop application with a web UI which embeds an existing machine learning model for timbre transfer. We will look at an example of a meaningful control of the model for creative use in interactive, real-time sound generation.

Finally, we will use interactive machine learning to define a personalised way of controlling the instrument based on a few examples provided on the fly.

Workshop goals:

• Demonstrate a practical example of creating a musical instrument with custom gesture control.
• Walk you through a typical architecture of a real-time system with interactive control.
• Show you how to run an existing machine learning model for timbre transfer on your computer and embed it in a desktop application.
• Discuss ways for incorporating interactive methods for augmenting user interactions.