The initial prototype consisted of a gesture-controlled mp3 player that also provided vibro-haptic feedback to aid gesture formation. Video demo provided:

The final prototype could identify and execute several gestures that controlled a music player on a laptop. The implemented interaction model allowed basic input browsing (i.e. confirm, undo). The vibro-haptic feedback replicated the gestural patterns to inform user of the recognized gesture. A study was piloted to asses initial usability. Video demo provided:

Four of us took part in this project. Two team members acted as leads on the hardware and software development of the prototype. One other member focused on the report-write up.

As the sole HCI student on the team, I contributed by working on establishing a positive and usable user-experience for the device. I strove to enhance learnability by selecting gestures that followed the natural mapping usually attributed to music player controls. By adding the ability to confirm and undo a gesture within a comprehensive new interaction model with corresponding vibro-haptic feedback, I improved the system robustness. At the moment, the device flexibility is limited, but future iterations may utilize machine learning to create a customizable set of gestures for every user.

Finally, I laid out a detailed experiment design to study the usability of the device. We ran a pilot and presented several findings related to the device and the study itself for future designers.

Aside from my role as a user evangelist, I also produced and edited the final videos.