For this project, we are exploring alternative forms of control connecting to digital keyboards. Drawing from our own experience, we initially identified two main pain points during the interaction process: 1. users need to flip music notes which makes the act of play less smooth; 2. users need to press on one foot to initiate actions of the sustain pedal, which takes more time to be trained comparing to just utilizing the upper body.

In order to sense signals in the most efficient way, we incorporated Muse headband - a wearable brain sensing headband that measures brain activity via 4 eletroencephalography (EEG) sensors. For project Musec, we used EEG sensors for blink detection, as well as accelerometer to sense head position - tilting towards either left or right.

Users are able to control the pedal with actions of blinking (noding in another version) and flip pages left or right via the actions of head tilting. Musec strives to incorporate beginning learners, piano practitioners, and marginalized community of disabled people as target audiences that they could potentially benefit from the new ways of interaction.

Design Choices: 

Detection of nodes: Initially we started with using absolute value, but considering user experience we decided to avoid that. Limiting users to node only on a certain range of height is not ideal nor practical. We used previous state/current state comparison to calculate the difference of height in detecting the action of node. Right now no matter what initial position the user is at, the band will be calibrated into their head position.

Flipping left and right: We used tilting head into left / right to decided whether the page is flipped towards which direction. It matches with general assumptions of human behaviour. We decide to detect tilting head instead of turning head around, based on the fact that players need to keep their eye on the music notes, while turning head might hinder such focus.

Tempo/Rhythm - Metronome: It's difficult for piano/keyboard beginners to know when to press on the sustain pedal. The actions of blinking or noding at the start of each section match with the rhythm and clicking sound generated by relay serves as a metronome.

Parts List:

Muse Band 2014

Relay module

6.35mm jack

Arduino Uno

Digital Keyboard

Mobile phone & laptop