README.md

Object Classification

Visual questions can provide information about the object classes that are present in the image. E.g., asking “what color is the bus?” indicates the presence of a bus in the image.

File descriptions:

1. question_to_label_simple.ipynb: Simple version of the question text to image label conversion process
2. question_to_label_complex.ipynb: Complex version of the question text to image label conversion process which uses NLTK and pattern.en

See the Supplementary for the detailed algorithm.