Title

Image annotation as Text-Image matching: Challenge design and results

Author

Luis Luis Pellegrin

OCTAVIO LOYOLA GONZALEZ

JOSE ORTIZ BEJAR

MIGUEL ANGEL MEDINA PEREZ

ANDRES EDUARDO GUTIERREZ RODRIGUEZ

Eric Sadit Téllez Avila

MARIO GRAFF GUERRERO

SABINO MIRANDA JIMENEZ

Daniela Moctezuma

MAURICIO ALFONSO GARCIA LIMON

ALICIA MORALES REYES

CARLOS ALBERTO REYES GARCIA

Eduardo Morales Manzanares

Hugo Jair Escalante

Access level

Open Access

Publication reference

URL/https://www.cys.cic.ipn.mx/ojs/index.php/CyS/article/view/3207/2723

doi: doi: 10.13053/CyS-23-4-3207

Summary or description

This paper describes the design of the 2017 RedICA: Text-Image Matching (RICATIM) challenge, including the dataset generation, a complete analysis of results, and the descriptions of the top-ranked developed methods. The academic challenge explores the feasibility of a novel binary image classification scenario, where each instance corresponds to the concatenation of learned representations of an image and a word. Instances are labeled as positive if the word is relevant for describing the visual content of the image, and negative otherwise. This novel approach of the image classification problem poses an alternative scenario where any text-image pair can be represented in such space, so any word could be considered for describing an image. The proposed methods are diverse and competitive, showing considerable improvements over the proposed baselines.

Publisher

Instituto Politécnico Nacional

Publish date

2019

Publication type

Article

Publication version

Published Version

Format

application/pdf

Source

Computación y Sistemas, volumen 23, número 4

Language

English

Citation suggestion

Pellegrin, L., Loyola González, O., Ortiz Bejar, J., Medina Pérez M. A., Gutiérrez Rodríguez, A. E., Tellez, E. S., Graff, M., Miranda Jiménez, S., Moctezuma, D., García Limón, M., Morales Reyes, A., Reyes García, C. A., Morales, E., Esclalante, H. J., 2019. Image annotation as Text-Image matching: Challenge design and results. Computación y Sistemas, Vol. 23, No. 4, pp. 1305–1321. doi: 10.13053/CyS-23-4-3207

Source repository

Repositorio Institucional de INFOTEC

Downloads

27

Comments



You need to sign in or sign up to comment.