Learning Hierarchical Features for Scene Labeling

Abstract : Scene labeling consists in labeling each pixel in an image with the category of the object it belongs to. We propose a method that uses a multiscale convolutional network trained from raw pixels to extract dense feature vectors that encode regions of multiple sizes centered on each pixel. The method alleviates the need for engineered features, and produces a powerful representation that captures texture, shape and contextual information. We report results using multiple post-processing methods to produce the final labeling. Among those, we propose a technique to automatically retrieve, from a pool of segmentation components, an optimal set of components that best explain the scene; these components are arbitrary, e.g. they can be taken from a segmentation tree, or from any family of over-segmentations. The system yields record accuracies on the Sift Flow Dataset (33 classes) and the Barcelona Dataset (170 classes) and near-record accuracy on Stanford Background Dataset (8 classes), while being an order of magnitude faster than competing approaches, producing a 320 × 240 image labeling in less than a second, including feature extraction.
Type de document :
Article dans une revue
IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2013, 35 (8), pp.1915 - 1929. <10.1109/TPAMI.2012.231>
Liste complète des métadonnées

https://hal-upec-upem.archives-ouvertes.fr/hal-00742077
Contributeur : Laurent Najman <>
Soumis le : lundi 15 octobre 2012 - 17:51:07
Dernière modification le : jeudi 4 juillet 2013 - 11:03:39
Document(s) archivé(s) le : jeudi 17 janvier 2013 - 11:30:19

Fichier

farabet-pami-13.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Clément Farabet, Camille Couprie, Laurent Najman, Yann Lecun. Learning Hierarchical Features for Scene Labeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2013, 35 (8), pp.1915 - 1929. <10.1109/TPAMI.2012.231>. <hal-00742077>

Partager

Métriques

Consultations de
la notice

468

Téléchargements du document

5945