Abstract
The automation of information extraction from ESG reports has recently become a topic of increasing interest in the Natural Language Processing community. While such information is highly relevant for socially responsible investments, identifying the specific issues discussed in a corporate social responsibility report is one of the first steps in an information extraction pipeline. In this paper, we evaluate methods for tackling the Multilingual Environmental, Social and Governance (ESG) Issue Identification Task. Our experiments use existing datasets in English, French and Chinese with a unified label set. Leveraging multilingual language models, we compare two approaches that are commonly adopted for the given task: off-the-shelf and fine-tuning. We show that fine-tuning models end-to-end is more robust than off-the-shelf methods. Additionally, translating text into the same language has negligible performance benefits.
Original language | English |
---|---|
Title of host publication | Joint Workshop of the 7th Financial Technology and Natural Language Processing, the 5th Knowledge Discovery from Unstructured Data in Financial Services and the 4th Economics and Natural Language Processing, FinNLP-KDF-ECONLP 2024 at LREC-COLING 2024 - Workshop Proceedings |
Editors | Chung-Chi Chen, Zhiqiang Ma, Udo Hahn |
Publisher | Association for Computational Linguistics (ACL) |
Pages | 50-58 |
Number of pages | 9 |
ISBN (Electronic) | 978-2-493814-19-7 |
Publication status | Published - May 2024 |
Event | Joint Workshop of the 7th Financial Technology and Natural Language Processing (FinNLP), the 5th Knowledge Discovery from Unstructured Data in Financial Services (KDF), and The 4th Workshop on Economics and Natural Language Processing (ECONLP) - Turin, Italy Duration: 20 May 2024 → 20 May 2024 https://sites.google.com/nlg.csie.ntu.edu.tw/finnlp-kdf-2024/call-for-papers |
Publication series
Name | Joint Workshop of the 7th Financial Technology and Natural Language Processing, the 5th Knowledge Discovery from Unstructured Data in Financial Services and the 4th Economics and Natural Language Processing, FinNLP-KDF-ECONLP 2024 at LREC-COLING 2024 - Workshop Proceedings |
---|
Conference
Conference | Joint Workshop of the 7th Financial Technology and Natural Language Processing (FinNLP), the 5th Knowledge Discovery from Unstructured Data in Financial Services (KDF), and The 4th Workshop on Economics and Natural Language Processing (ECONLP) |
---|---|
Abbreviated title | finnlp-kdf-2024 |
Country/Territory | Italy |
City | Turin |
Period | 20/05/24 → 20/05/24 |
Internet address |
Keywords
- ESG Reports
- Pre-trained Language Models
- Cross-lingual Transfer
- Text Classification
- Multilingual NLP