News2Image: Automated System of Image Recommendation to News Articles

2020

Closed access Metadata (CSL-JSON)
DOI 10.1109/ipas50080.2020.9334931
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

This paper presents an image recommendation system called “News2Image”, which takes as input a news text and outputs a small set of images selected from the database such that the selected images present contexts similar to the keywords of the input text. The proposed framework starts by preprocessing and summarizing the news for the selection of its keywords, which are then converted to vectors using word2vec. The framework associates each database image with a set of sentences describing its content using image captioning. After preprocessing the sentences and translating them into the word vectors as performed for input news texts, the word subspaces are compared using the Mutual Subspace Method (MSM). Experimental evaluation of the proposed framework including a comparison with the previous approach demonstrates its overall effectiveness.