Decentralized, not Dehumanized in the Metaverse: Bringing Utility to NFTs through Multimodal Interaction

Anqi Wang, Ze Gao, Lik Hang Lee, Tristan Braud, Pan Hui

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

17 Citations (Scopus)

Abstract

User Interaction for NFTs (Non-fungible Tokens) is gaining increasing attention. Although NFTs have been traditionally single-use and monolithic, recent applications aim to connect multimodal interaction with human behavior. This paper reviews the related technological approaches and business practices in NFT art. We highlight that multimodal interaction is a currently under-studied issue in mainstream NFT art, and conjecture that multimodal interaction is a crucial enabler for decentralization in the NFT community. We present a continuum theory and propose a framework combining a bottom-up approach with AI multimodal process. Through this framework, we put forward integrating human behavior data into generative NFT units, as "multimodal interactive NFT."Our work displays the possibilities of NFTs in the art world, beyond the traditional 2D and 3D static content.

Original languageEnglish
Title of host publicationICMI 2022 - Proceedings of the 2022 International Conference on Multimodal Interaction
PublisherAssociation for Computing Machinery
Pages662-667
Number of pages6
ISBN (Electronic)9781450393904
DOIs
Publication statusPublished - 7 Nov 2022
Externally publishedYes
Event24th ACM International Conference on Multimodal Interaction, ICMI 2022 - Bangalore, India
Duration: 7 Nov 202211 Nov 2022

Publication series

NameACM International Conference Proceeding Series

Conference

Conference24th ACM International Conference on Multimodal Interaction, ICMI 2022
Country/TerritoryIndia
CityBangalore
Period7/11/2211/11/22

Keywords

  • AI-generated art
  • interaction
  • multimodal
  • NFTs
  • text-to-image
  • the Metaverse

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Decentralized, not Dehumanized in the Metaverse: Bringing Utility to NFTs through Multimodal Interaction'. Together they form a unique fingerprint.

Cite this