Semantic Search for Data on a Given Topic in Social Networks: A Comparative Study of Keyword-based and BERT-based Methods

2025

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.9734/ajrcos/2025/v18i6701
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Semantic search has emerged as a powerful alternative to traditional keyword-based retrieval, particularly in the context of unstructured social media data. This study presents a comparative analysis of a semantic search system based on Sentence-BERT (SBERT) and a conventional keyword-based pipeline implemented with Elasticsearch, using a large Reddit dataset as a case study. The primary contribution lies in integrating state-of-the-art semantic modeling with scalable search infrastructure and empirically evaluating its effectiveness on real-world social media content. The experimental workflow includes six stages: dataset selection, preprocessing, embedding generation, indexing, query processing, and performance evaluation. Results show that the SBERT-based semantic search system consistently outperforms the keyword-based approach across all metrics, particularly in capturing user intent, handling informal language, and retrieving semantically relevant content despite lexical variations. Nonetheless, the semantic approach incurs higher computational costs and exhibits occasional overgeneralization.