Comparison of traditional machine learning methods and Google services in identifying tonality on Russian texts

2018

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.1088/1742-6596/1117/1/012002
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Classification of text is very important and interesting topic for research due to number of unstructured data and especially in the form of news. The problem arises when classifying news that is written in language other than english. Due to poor support of research done in this field and general language complexity, it is very hard to identify correctly, tone and sentiment of a text. This problems can be avoided by applying various techniques at many stages of this model. Choosing proper technique can be very tricky and would affect efficiency of a model and can save time as well as working time. The aim of this paper is to compare traditional machine learning techniques with Google services by using Translate API and see how well they perform while working with Russian texts. On traditional machine learning techniques after applying pre-processing methods which included stemming, parsing and indexing and by using various different methods of embedding turns our unstructured data into a structured data.