TY - JOUR
T1 - Supervised cross-momentum contrast
T2 - Aligning representations with prototypical examples to enhance financial sentiment analysis
AU - Peng, Bo
AU - Chersoni, Emmanuele
AU - Hsu, Yu Yin
AU - Qiu, Le
AU - Huang, Chu-Ren
N1 - Publisher Copyright:
© 2024 The Author(s)
PY - 2024/7/8
Y1 - 2024/7/8
N2 - Financial sentiment analysis plays a pivotal role in understanding market dynamics and investor sentiment. In this paper, we propose the Supervised Cross-Momentum Contrast (SuCroMoCo) framework, a novel approach for financial sentiment analysis. SuCroMoCo leverages supervised contrastive learning and cross-momentum contrast to align financial text representations with prototypical representations based on sentiment categories. This alignment greatly improves classification performance, addressing the limitations of pre-trained language models (PLMs) in fully grasping the intricate nature of financial text. Through extensive experiments, we demonstrate that SuCroMoCo outperforms existing PLMs-based approaches and Large Language Models (LLMs) on diverse benchmark datasets.
AB - Financial sentiment analysis plays a pivotal role in understanding market dynamics and investor sentiment. In this paper, we propose the Supervised Cross-Momentum Contrast (SuCroMoCo) framework, a novel approach for financial sentiment analysis. SuCroMoCo leverages supervised contrastive learning and cross-momentum contrast to align financial text representations with prototypical representations based on sentiment categories. This alignment greatly improves classification performance, addressing the limitations of pre-trained language models (PLMs) in fully grasping the intricate nature of financial text. Through extensive experiments, we demonstrate that SuCroMoCo outperforms existing PLMs-based approaches and Large Language Models (LLMs) on diverse benchmark datasets.
KW - Financial sentiment analysis
KW - Pre-trained language models
KW - Supervised contrastive learning
KW - Cross-momentum contrast
UR - http://www.scopus.com/inward/record.url?scp=85191861161&partnerID=8YFLogxK
U2 - 10.1016/j.knosys.2024.111683
DO - 10.1016/j.knosys.2024.111683
M3 - Journal article
SN - 0950-7051
VL - 295
JO - Knowledge-Based Systems
JF - Knowledge-Based Systems
M1 - 111683
ER -