Investigation of technologies of processing of big data

2017

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.26577/ijmph.2017.v8.i2.02
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

An overview of the technologies and methods is presented, on the basis of which the authors of this article model the processing of a large amount of data, developing a web application. In particular, it is proposed to combine models to improve the efficiency of processing large amounts of data. Large data set before traditional storage systems and processing a new challenge. This article analyzes possible methods their decisions, limitations that do not allow to do it effectively, and also provides an overview of three modern approaches to working with large data: NoSQL and real-time event flow processing. Analysis of large data requires the use of technology and the means to implement highly productive computing. The main factors of the problem are, first of all, the complexity and the second physical volume of the information collection. It should be noted that the actual processing of data includes the construction of the algorithm and the time for its description and debugging. Unique data collections require the development of unique algorithms, which increases the total processing time by an order of magnitude. G M T Английский Испанский Итальянский Казахский Китайский Трад Китайский Упр Корейский Русский Турецкий Французский Английский Испанский Итальянский Казахский Китайский Трад Китайский Упр Корейский Русский Турецкий Французский Звуковая функция ограничена 200 символами Настройки : История : Обратная связь : Donate Закрыть