Video Digest based on Heart Rate

S. Toyosawa and T. Kawai (Japan)


Video digest, video analysis, heart rate, psychophysiology, emotion, affect


In video digesting, not only features and keywords ex tracted from a content itself but viewer’s input are essen tial to incorporate subjective impressions and perceived im portance. The present study aims at providing heart rate based arousal level as weights for determining shots that are deemed impressive and consuming. Heart rate is suit able for video content analysis, as it can be measured with out being obtrusive and can be the source of different types of psychophysiological indices. Based on the findings that heart rate decelerates when emotionally arousing images are shown, we had investigated the fidelity of heart rate in detecting impressive shots. Three video contents with different valence/arousal levels were presented to the sub jects, and the heart rate based “best shot” selections were compared against subjects-selected shots. The resulting hit ratio was 37% (the probability of random guessing is 17%). This result is about the same as other physiology-based af fect recognition mechanisms with one class of input. We can expect this fidelity to be improved further by combin ing other heart rate based measures such as heart rate vari ability.

Important Links:

Go Back