Transformers-Based Approach for a Sustainability Term-Based Sentiment Analysis (STBSA)

Blaise W. Sandwidi, Suneer Pallitharammal Mukkolakal

2022

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.18653/v1/2022.nlp4pi-1.19
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Traditional sentiment analysis is a sentencelevel or document-level task.However, a sentence or paragraph may contain multiple target terms with different sentiments, making sentiment prediction more challenging.Although pre-trained language models like BERT have been successful, incorporating dynamic semantic changes into aspect-based sentiment models remains difficult, especially for domainspecific sentiment analysis.To this end, in this paper, we propose a Term-Based Sentiment Analysis (TBSA), a novel method designed to learn Environmental, Social, and Governance (ESG) contexts based on a sustainability taxonomy for ESG aspect-oriented sentiment analysis.Notably, we introduce a technique enhancing the ESG term's attention, inspired by the success of attention-based neural networks in machine translation (Bahdanau et al., 2015) and Computer Vision (Bello et al., 2019).It enables the proposed model to focus on a small region of the sentences at each step and to reweigh the crucial terms for a better understanding of the ESG aspect-aware sentiment.Beyond the novelty in the model design, we propose a new dataset of 125,000+ ESG analystannotated data points for sustainability termbased sentiment classification, which derives from historical sustainability corpus data and expertise acquired by development finance institutions.Our extensive experiments combining the new method and the new dataset demonstrate the effectiveness of the Sustainability TBSA model with an accuracy of 91.30% (90% F1-score).Both internal and external business applications of our model show an evident potential for a significant positive impact toward furthering sustainable development goals (SDGs).