Immersive Learning and Multimodal Representation in First and Second Language

    Activity: Talk or presentationInvited talk

    Description

    How can we take advantage of the rapid developments in digital technology and AI to study language learning and promote learning effectiveness? I outline an approach that combines emerging technologies and data-driven methodologies with current neurocognitive theories, with particular reference to second language learning and representation. I highlight the interactive mechanisms and integrative processes that enable us to understand the differences between child and adult language learning, as well as individual differences in diverse language learning contexts. The key to this approach is the understanding of how human learners effectively integrate multimodal information in a social-emotional learning context. Specifically, I will argue that adults learning a second language can arrive at similar neurocognitive representations as children learning a native language if given the rich multimodal perception and action contexts in which language is naturally acquired. This perspective also allows us to consider integrating learning theories with technological designs that meet individual learners’ needs and learning profiles. This is especially feasible given today’s technologies of combining metaverse with AI-based human-computer interactions.
    Period5 Jul 2024
    Event titleInternational Conference on Technology-Enhanced Language Learning and Teaching & Corpus-based Language Learning and Teaching 2024
    Event typeConference
    LocationHong Kong, ChinaShow on map
    Degree of RecognitionInternational

    Keywords

    • immersive technology
    • second language learning
    • LLMs
    • neuroscience,
    • multimodal representation