TY - GEN
T1 - Are Language Models Sensitive to Semantic Attraction? A Study on Surprisal
AU - Cong, Yan
AU - Chersoni, Emmanuele
AU - Hsu, Yu Yin
AU - Lenci, Alessandro
N1 - Publisher Copyright:
© 2023 Association for Computational Linguistics.
PY - 2023/7
Y1 - 2023/7
N2 - In psycholinguistics, semantic attraction is a sentence processing phenomenon in which a given argument violates the selectional requirements of a verb, but this violation is not perceived by comprehenders due to its attraction to another noun in the same sentence, which is syntactically unrelated but semantically sound. In our study, we use autoregressive language models to compute the sentence-level and the target phrase-level Surprisal scores of a psycholinguistic dataset on semantic attraction. Our results show that the models are sensitive to semantic attraction, leading to reduced Surprisal scores, although none of them perfectly matches the human behavioral patterns.
AB - In psycholinguistics, semantic attraction is a sentence processing phenomenon in which a given argument violates the selectional requirements of a verb, but this violation is not perceived by comprehenders due to its attraction to another noun in the same sentence, which is syntactically unrelated but semantically sound. In our study, we use autoregressive language models to compute the sentence-level and the target phrase-level Surprisal scores of a psycholinguistic dataset on semantic attraction. Our results show that the models are sensitive to semantic attraction, leading to reduced Surprisal scores, although none of them perfectly matches the human behavioral patterns.
UR - http://www.scopus.com/inward/record.url?scp=85175399318&partnerID=8YFLogxK
M3 - Conference article published in proceeding or book
AN - SCOPUS:85175399318
T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics
SP - 141
EP - 148
BT - StarSEM 2023 - 12th Joint Conference on Lexical and Computational Semantics, Proceedings of the Conference
A2 - Palmer, Alexis
A2 - Camacho-Collados, Jose
PB - Association for Computational Linguistics (ACL)
T2 - 12th Joint Conference on Lexical and Computational Semantics, StarSEM 2023, co-located with ACL 2023
Y2 - 13 July 2023 through 14 July 2023
ER -