Introduction to a framework for multi-modal and tangible interaction

Kenneth W.K. Lo; Will W.W. Tang; Grace Ngai; Stephen C.F. Chan; Jason T.P. Tse

doi:10.1109/ICSMC.2010.5641977

Introduction to a framework for multi-modal and tangible interaction

Kenneth W.K. Lo, Will W.W. Tang, Grace Ngai, Stephen C.F. Chan, Jason T.P. Tse

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

1 Citation (Scopus)

Abstract

This paper introduces the Multi-modal Interface Framework (MIF). It is a system which allows developers to easily integrate interface devices of multiple modalities, such as voice, hand and finger gestures, and various tangible devices such as game controllers into a multi-modal input system. The integrated devices can then be used to control practically any computer application. The advantages offered by MIF are ease of use, flexibility and support for collaboration. Its design has been validated by applying it to integrate finger gestures, voice, a Wii mote and an iPhone to control applications such as Google Earth and Windows Media Player.

Original language	English
Title of host publication	2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010
Pages	3001-3007
Number of pages	7
DOIs	https://doi.org/10.1109/ICSMC.2010.5641977
Publication status	Published - 1 Dec 2010
Event	2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010 - Istanbul, Turkey Duration: 10 Oct 2010 → 13 Oct 2010

Conference

Conference	2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010
Country/Territory	Turkey
City	Istanbul
Period	10/10/10 → 13/10/10

Keywords

Multi-modal interface
Tangible interface
User interface framework

ASJC Scopus subject areas

Electrical and Electronic Engineering
Control and Systems Engineering
Human-Computer Interaction

More information

10.1109/ICSMC.2010.5641977

Cite this

@inproceedings{d82b1ba5b93f4cd186af0f985b29d8b2,

title = "Introduction to a framework for multi-modal and tangible interaction",

abstract = "This paper introduces the Multi-modal Interface Framework (MIF). It is a system which allows developers to easily integrate interface devices of multiple modalities, such as voice, hand and finger gestures, and various tangible devices such as game controllers into a multi-modal input system. The integrated devices can then be used to control practically any computer application. The advantages offered by MIF are ease of use, flexibility and support for collaboration. Its design has been validated by applying it to integrate finger gestures, voice, a Wii mote and an iPhone to control applications such as Google Earth and Windows Media Player.",

keywords = "Multi-modal interface, Tangible interface, User interface framework",

author = "Lo, {Kenneth W.K.} and Tang, {Will W.W.} and Grace Ngai and Chan, {Stephen C.F.} and Tse, {Jason T.P.}",

year = "2010",

month = dec,

day = "1",

doi = "10.1109/ICSMC.2010.5641977",

language = "English",

isbn = "9781424465880",

pages = "3001--3007",

booktitle = "2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010",

note = "2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010 ; Conference date: 10-10-2010 Through 13-10-2010",

}

Lo, KWK, Tang, WWW, Ngai, G, Chan, SCF & Tse, JTP 2010, Introduction to a framework for multi-modal and tangible interaction. in 2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010., 5641977, pp. 3001-3007, 2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010, Istanbul, Turkey, 10/10/10. https://doi.org/10.1109/ICSMC.2010.5641977

Introduction to a framework for multi-modal and tangible interaction. / Lo, Kenneth W.K.; Tang, Will W.W.; Ngai, Grace et al.
2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010. 2010. p. 3001-3007 5641977.

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

TY - GEN

T1 - Introduction to a framework for multi-modal and tangible interaction

AU - Lo, Kenneth W.K.

AU - Tang, Will W.W.

AU - Ngai, Grace

AU - Chan, Stephen C.F.

AU - Tse, Jason T.P.

PY - 2010/12/1

Y1 - 2010/12/1

N2 - This paper introduces the Multi-modal Interface Framework (MIF). It is a system which allows developers to easily integrate interface devices of multiple modalities, such as voice, hand and finger gestures, and various tangible devices such as game controllers into a multi-modal input system. The integrated devices can then be used to control practically any computer application. The advantages offered by MIF are ease of use, flexibility and support for collaboration. Its design has been validated by applying it to integrate finger gestures, voice, a Wii mote and an iPhone to control applications such as Google Earth and Windows Media Player.

AB - This paper introduces the Multi-modal Interface Framework (MIF). It is a system which allows developers to easily integrate interface devices of multiple modalities, such as voice, hand and finger gestures, and various tangible devices such as game controllers into a multi-modal input system. The integrated devices can then be used to control practically any computer application. The advantages offered by MIF are ease of use, flexibility and support for collaboration. Its design has been validated by applying it to integrate finger gestures, voice, a Wii mote and an iPhone to control applications such as Google Earth and Windows Media Player.

KW - Multi-modal interface

KW - Tangible interface

KW - User interface framework

UR - http://www.scopus.com/inward/record.url?scp=78751508480&partnerID=8YFLogxK

U2 - 10.1109/ICSMC.2010.5641977

DO - 10.1109/ICSMC.2010.5641977

M3 - Conference article published in proceeding or book

SN - 9781424465880

SP - 3001

EP - 3007

BT - 2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010

T2 - 2010 IEEE International Conference on Systems, Man and Cybernetics, SMC 2010

Y2 - 10 October 2010 through 13 October 2010

ER -

Introduction to a framework for multi-modal and tangible interaction

Abstract

Conference

Keywords

ASJC Scopus subject areas

More information

Other files and links

Fingerprint

Cite this