Blog Link

This is a Blog about Josh's 2011 Thesis at Usyd, others like it can be found here

Monday, 24 October 2011

Emotion detection in faces in an audience

Having seen the MIT Moodmeter, it seems like a better way to give feed back to a public speaker is by monitoring the audience. This will tell you if the speaker is really engaging the listeners which is really the prime measure of successful public speaking.

By recording the speak when monitoring the emotions of an audience, eg, happy or bored. you can inform the speaker where they started to lose the audience. The following articles concern emotion detection.

Affective Content Detection by Using Timing Features and Fuzzy Clustering
Min Xu, Suhuai Luo, and Jesse S. Jin

A robust multimodal approach for emotion recognition
Mingli Song Ã, Mingyu You, Na Li, Chun Chen

Emotion Recognition Based on Joint Visual and Audio Cues
Nicu Sebe, Ira Cohen, Theo Gevers, Thomas S. Huang

Neuro forge have a system they call synotive could be useful for emotion detection library.

I will have to decide if it will be feasible to use Kinect as i doubt it could fit more than 10 people in frame at a distance that its depth sensors will function. it may be nececary to use somthing different for or just restrict the project to work with small sample groups.

Posture Detection for better public speaking

Initially I felt the best way to quantify the quality of public speaking was through the posture and appearance of the speaker, and thus give feed back. So I had concerned myself with how to detect the shape and position of a body. from this you could instruct the speaker on things like posture, however challenge would be that people are very different shapes and sizes and have a different posture to begin with. Any changes in their posture that may be indicative of a lapse in focus will vary from person to person. Some of the papers I have looked at regarding posture and body position detection:

Human Position/Height Detection Using Analog Type Pyroelectric Sensors
Shinya Okuda, Shigeo Kaneda, and Hirohide Haga

Laser-Based Tracking of Human Position and Orientation Using Parametric Shape Modeling
Dylan F. Glas, Takahiro Miyashita, Hiroshi Ishiguro and Norihiro Hagita

Human posture recognition for intelligent vehicles
Juan P. Wachs • Mathias Kolsch • Deborah Goshorn