A Case Study for Language-Free Keyword Extraction with Statistical and Graph-Based Features

2024

Closed access Metadata (CSL-JSON)
DOI 10.1109/icci61671.2024.10485164
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

For text mining applications, keyword extraction is a popular problem to solve. The text mining applications as indexing, summarization and topic tracking uses keyword extraction models as baseline. There are many sequence labeling models proposed in the literature. The performance results, however, did not meet expectations. In this paper, we use many selective statistical and graph-based features to solve the keyword extraction problem. We calculated many selective features for each considerable word in input text. We used Random Forest token classification model. In addition to widely used 500N-KPCrowd dataset in the literature, we trained and tested publicly available KazakhNews and RussianNews datasets to extend language domain. Moreover, we collected two news dataset in Chinese and Arabic languages namely ChineseNews and ArabianNews. We also used a Turkish abstract dataset DergiParkTR for comparison. The performance of the graph-based and statistical features were tested with Random forest algorithm. We have obtained 0.680, 0.706 and 0.896 F1-scores for DergiParkTR, 500N-KPCrowd and RussianNews datasets respectively. We attained the best performance of 0.978 for KazakhNews using graph-based features and 0.999 for ChineseNews datasets with all statistical features.