Skip to Main content Skip to Navigation
Conference papers

Mind the regularized GAP, for human action classification and semi-supervised localization based on visual saliency

Abstract : This work addresses the issue of image classification and localization of human actions based on visual data acquired from RGB sensors. Our approach is inspired by the success of deep learning in image classification. In this paper, we describe our method and how the concept of Global Average Pooling (GAP) applies in the context of semi-supervised class localization. We benchmark it with respect to Class Activation Mapping initiated in (Zhou et al., 2016), propose a regularization over the GAP maps to enhance the results, and study whether a combination of these two ideas can result in a better classification accuracy. The models are trained and tested on the Stanford 40 Action dataset (Yao et al., 2011) describing people performing 40 different actions such as drinking, cooking or watching TV. Compared to the aforementioned baseline, our model improves the classification accuracy by 5.3 percent points, achieves a localization accuracy of 50.3%, and drastically diminishes the computation needed to retrieve the class saliency from the base convolutional model.
Document type :
Conference papers
Complete list of metadatas

Cited literature [15 references]  Display  Hide  Download

https://hal.laas.fr/hal-01763103
Contributor : Frédéric Lerasle <>
Submitted on : Tuesday, April 10, 2018 - 5:11:28 PM
Last modification on : Tuesday, September 8, 2020 - 10:02:02 AM

File

paper-final.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01763103, version 1

Citation

Marc Moreaux, Natalia Lyubova, Isabelle Ferrané, Frédéric Lerasle. Mind the regularized GAP, for human action classification and semi-supervised localization based on visual saliency. 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Jan 2018, Funchal, Portugal. ⟨hal-01763103⟩

Share

Metrics

Record views

293

Files downloads

301