top of page

Facial Recognition

This experiment looks at the use of facial recognition as an input to control sound. This program uses OpenFrameworks and was created by Gene Kogan and can be found at this URL:

​

https://github.com/genekogan/ofxFaceTracker

This program can measure the details on the users face to identify facial emotions or features. This experiment works reliably well and the user is able to control a soundscape by expressing different facial emotions. 

​

I considered matching the expressions with ways of manipulations. The lowpass filter is controlled by the shutting of the users eyes, the wider the eyes are the brighter the sound and vice versa. The reverb will increase becoming a more open space when the mouth of the user is open. And the reso chord will be more prominent as the eyebrows of the users lift, introducing a happier melodic atmosphere.

​

The compositions made this project run from generated sound, therefore there is no beginning or end. The use of this technique within sound art installations means that there is no need to restart the composition. Although some parameters are drawn in to happen by themselves, the user controls the most important and prominent parameters of the composition.

Screen Shot 2019-12-10 at 11.39.20.png
bottom of page