MelodicBrush: A cross-modal link between ancient and digital art forms

Michael Xuelin Huang; Will W W Tang; Kenneth W K Lo; C. K. Lau; Grace Ngai; Stephen Chan

doi:10.1145/2212776.2212369

MelodicBrush: A cross-modal link between ancient and digital art forms

Michael Xuelin Huang, Will W W Tang, Kenneth W K Lo, C. K. Lau, Grace Ngai, Stephen Chan

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

3 Citations (Scopus)

Abstract

MelodicBrush is a novel cross-modal musical system that connects two ancient art forms: Chinese ink-brush calligraphy and Chinese music. Our system endows the process of calligraphy writing with a novel auditory representation in a natural and intuitive manner to create a novel artistic experience. The writing effect is simulated as though the user were writing on an infinitely large piece of paper viewed through a viewport. The real-time musical generation effects are motivated by principles of metaphoric congruence and statistical music modeling.

Original language	English
Title of host publication	Extended Abstracts - The 30th ACM Conference on Human Factors in Computing Systems, CHI 2012
Pages	995-998
Number of pages	4
DOIs	https://doi.org/10.1145/2212776.2212369
Publication status	Published - 27 Jun 2012
Event	30th ACM Conference on Human Factors in Computing Systems, CHI 2012 - Austin, TX, United States Duration: 5 May 2012 → 10 May 2012

Conference

Conference	30th ACM Conference on Human Factors in Computing Systems, CHI 2012
Country/Territory	United States
City	Austin, TX
Period	5/05/12 → 10/05/12

Keywords

chinese calligraphy
chinese music
cross-modal interaction

ASJC Scopus subject areas

Software
Human-Computer Interaction
Computer Graphics and Computer-Aided Design

More information

10.1145/2212776.2212369

http://hdl.handle.net/10397/5194

Cite this

@inproceedings{c2455c7a1c114836bbfe00d00b284157,

title = "MelodicBrush: A cross-modal link between ancient and digital art forms",

abstract = "MelodicBrush is a novel cross-modal musical system that connects two ancient art forms: Chinese ink-brush calligraphy and Chinese music. Our system endows the process of calligraphy writing with a novel auditory representation in a natural and intuitive manner to create a novel artistic experience. The writing effect is simulated as though the user were writing on an infinitely large piece of paper viewed through a viewport. The real-time musical generation effects are motivated by principles of metaphoric congruence and statistical music modeling.",

keywords = "chinese calligraphy, chinese music, cross-modal interaction",

author = "Huang, {Michael Xuelin} and Tang, {Will W W} and Lo, {Kenneth W K} and Lau, {C. K.} and Grace Ngai and Stephen Chan",

year = "2012",

month = jun,

day = "27",

doi = "10.1145/2212776.2212369",

language = "English",

isbn = "9781450310161",

pages = "995--998",

booktitle = "Extended Abstracts - The 30th ACM Conference on Human Factors in Computing Systems, CHI 2012",

note = "30th ACM Conference on Human Factors in Computing Systems, CHI 2012 ; Conference date: 05-05-2012 Through 10-05-2012",

}

Huang, MX, Tang, WWW, Lo, KWK, Lau, CK, Ngai, G & Chan, S 2012, MelodicBrush: A cross-modal link between ancient and digital art forms. in Extended Abstracts - The 30th ACM Conference on Human Factors in Computing Systems, CHI 2012. pp. 995-998, 30th ACM Conference on Human Factors in Computing Systems, CHI 2012, Austin, TX, United States, 5/05/12. https://doi.org/10.1145/2212776.2212369

MelodicBrush: A cross-modal link between ancient and digital art forms. / Huang, Michael Xuelin; Tang, Will W W; Lo, Kenneth W K et al.
Extended Abstracts - The 30th ACM Conference on Human Factors in Computing Systems, CHI 2012. 2012. p. 995-998.

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

TY - GEN

T1 - MelodicBrush: A cross-modal link between ancient and digital art forms

AU - Huang, Michael Xuelin

AU - Tang, Will W W

AU - Lo, Kenneth W K

AU - Lau, C. K.

AU - Ngai, Grace

AU - Chan, Stephen

PY - 2012/6/27

Y1 - 2012/6/27

N2 - MelodicBrush is a novel cross-modal musical system that connects two ancient art forms: Chinese ink-brush calligraphy and Chinese music. Our system endows the process of calligraphy writing with a novel auditory representation in a natural and intuitive manner to create a novel artistic experience. The writing effect is simulated as though the user were writing on an infinitely large piece of paper viewed through a viewport. The real-time musical generation effects are motivated by principles of metaphoric congruence and statistical music modeling.

AB - MelodicBrush is a novel cross-modal musical system that connects two ancient art forms: Chinese ink-brush calligraphy and Chinese music. Our system endows the process of calligraphy writing with a novel auditory representation in a natural and intuitive manner to create a novel artistic experience. The writing effect is simulated as though the user were writing on an infinitely large piece of paper viewed through a viewport. The real-time musical generation effects are motivated by principles of metaphoric congruence and statistical music modeling.

KW - chinese calligraphy

KW - chinese music

KW - cross-modal interaction

UR - http://www.scopus.com/inward/record.url?scp=84862657111&partnerID=8YFLogxK

U2 - 10.1145/2212776.2212369

DO - 10.1145/2212776.2212369

M3 - Conference article published in proceeding or book

SN - 9781450310161

SP - 995

EP - 998

BT - Extended Abstracts - The 30th ACM Conference on Human Factors in Computing Systems, CHI 2012

T2 - 30th ACM Conference on Human Factors in Computing Systems, CHI 2012

Y2 - 5 May 2012 through 10 May 2012

ER -

MelodicBrush: A cross-modal link between ancient and digital art forms

Abstract

Conference

Keywords

ASJC Scopus subject areas

More information

Other files and links

Fingerprint

Cite this