Prose for a Painting

ICCV Workshop on Closing the Loop Between Vision and Language, 2019 Painting captions are often dry and simplistic which motivates us to describe a painting creatively in the style of Shakespearean prose. This is a difficult problem, since there does not exist a large supervised dataset from paintin...

Full description

Saved in:
Bibliographic Details
Main Authors Kashyap, Prerna, Phatale, Samrat, Drori, Iddo
Format Journal Article
LanguageEnglish
Published 08.10.2019
Subjects
Computer Science - Computation and Language
Computer Science - Computer Vision and Pattern Recognition
Computer Science - Learning
Online AccessGet full text
DOI10.48550/arxiv.1910.03634

Cover

More Information
Summary:ICCV Workshop on Closing the Loop Between Vision and Language, 2019 Painting captions are often dry and simplistic which motivates us to describe a painting creatively in the style of Shakespearean prose. This is a difficult problem, since there does not exist a large supervised dataset from paintings to Shakespearean prose. Our solution is to use an intermediate English poem description of the painting and then apply language style transfer which results in Shakespearean prose describing the painting. We rate our results by human evaluation on a Likert scale, and evaluate the quality of language style transfer using BLEU score as a function of prose length. We demonstrate the applicability and limitations of our approach by generating Shakespearean prose for famous paintings. We make our models and code publicly available.
DOI:10.48550/arxiv.1910.03634