MelodicBrush: A cross-modal link between ancient and digital art forms

Michael Xuelin Huang, Will W W Tang, Kenneth W K Lo, C. K. Lau, Grace Ngai, Stephen Chan

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

2 Citations (Scopus)

Abstract

MelodicBrush is a novel cross-modal musical system that connects two ancient art forms: Chinese ink-brush calligraphy and Chinese music. Our system endows the process of calligraphy writing with a novel auditory representation in a natural and intuitive manner to create a novel artistic experience. The writing effect is simulated as though the user were writing on an infinitely large piece of paper viewed through a viewport. The real-time musical generation effects are motivated by principles of metaphoric congruence and statistical music modeling.
Original languageEnglish
Title of host publicationExtended Abstracts - The 30th ACM Conference on Human Factors in Computing Systems, CHI 2012
Pages995-998
Number of pages4
DOIs
Publication statusPublished - 27 Jun 2012
Event30th ACM Conference on Human Factors in Computing Systems, CHI 2012 - Austin, TX, United States
Duration: 5 May 201210 May 2012

Conference

Conference30th ACM Conference on Human Factors in Computing Systems, CHI 2012
Country/TerritoryUnited States
CityAustin, TX
Period5/05/1210/05/12

Keywords

  • chinese calligraphy
  • chinese music
  • cross-modal interaction

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Cite this