Introduction

Music is arguably one of the most consumed art forms in the world, but very few of us traverse to the other side of actually making music - generally due to a lack of equipment and instruments, steep learning curves, complicated software and the requirement to commit hours and years to learning.

Despite these challenges, many of my peers have often expressed interest in making music - if only it were less com-plicated.

With this in mind - I decided to create a playful music making interface that anybody could use, simply using the movements of their hands.

This interface would provide a simple gateway for anyone to begin experiencing the joy of creating music.

Process and Technical Details

A camera based interface tracks the user’s hands and and music is played based on the position of their hands on the X and Y Axis - giving a sense of control and immediate feedback.

The X Axis determines what chord or notes are being played - and it is ensured that all notes are in a ‘diatonic’ space meaning there will be no ‘wrong’ or dissonant notes for first time users.

The Y axis determines the rate at which each chord is played again.

Visual effects like pulses emanate from the user's palm when a sound is produced, giving visual feedback.

Closing the palm of your hand stops the music.

User Testing and Response

It was fascinating to see people using the app - everybody approached it differently. Some people danced and moved in really interesting ways - but most importantly they all seemed to be having fun - at least for a good 5-10 minutes before moving on.

The way forward would be to add more gestures and depth so that people have the ability to dig deeper and experiment more with the creative expression, such as modulating audio effects like reverb with different gestures.