Robotic Systems in Heritage Protection: An Anti-Fatigue Human-Robot Collaboration Exploration for Heritage Painting and Calligraphy Restoration

Linyi Liu; Siqi Yang; Yixue Wang; Zhengtao Ma; Le Fang; Yonghao Long; Stephen Jia Wang

doi:10.1145/3584931.3606994

Robotic Systems in Heritage Protection: An Anti-Fatigue Human-Robot Collaboration Exploration for Heritage Painting and Calligraphy Restoration

Linyi Liu, Siqi Yang, Yixue Wang, Zhengtao Ma, Le Fang, Yonghao Long, Stephen Jia Wang (Corresponding Author)

School of Design

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

Abstract

The heritage restoration of paintings and calligraphy is a labour-intensive process, characterised by repetitive, low-intensity, and high-precision. Two core steps, “lift up the previous” and “fix and maintain”, can lead to muscle fatigue in the upper limbs. In this paper, we develop a human-in-the-loop based human-robot collaboration system that provides real-time force feedback to restorers based on their muscle load and motion intention, with the support strength changing to relieve fatigue. Different robot-aided positions on human arm are explored and a two-point elbow-supporting mechanism is evaluated as the optimal solution. Moreover, a novel muscle load calculation model is developed to integrate human factors into the HRC system with electromyography. The results of a usability experiment show the effectiveness of the proposed method in addressing the current anti-fatigue challenge in heritage paintings and calligraphy restoration.

Original language	English
Title of host publication	CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing
Editors	Morgan Ames, Susan Fussell, Eric Gilbert, Vera Liao, Xiaojuan Ma, Xinru Page, Mark Rouncefield, Vivek Singh, Pamela Wisniewski
Publisher	Association for Computing Machinery (ACM)
Pages	201–205
Number of pages	5
ISBN (Electronic)	9798400701290
DOIs	https://doi.org/10.1145/3584931.3606994
Publication status	Published - 14 Oct 2023

Publication series

Name	Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

Keywords

Anti-Fatigue
Electromyography
Heritage Restoration
Human-Robot Collaboration

ASJC Scopus subject areas

Software
Human-Computer Interaction
Computer Networks and Communications

More information

10.1145/3584931.3606994

Cite this

Liu, L., Yang, S., Wang, Y., Ma, Z., Fang, L., Long, Y., & Wang, S. J. (2023). Robotic Systems in Heritage Protection: An Anti-Fatigue Human-Robot Collaboration Exploration for Heritage Painting and Calligraphy Restoration. In M. Ames, S. Fussell, E. Gilbert, V. Liao, X. Ma, X. Page, M. Rouncefield, V. Singh, & P. Wisniewski (Eds.), CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing (pp. 201–205). (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW). Association for Computing Machinery (ACM). https://doi.org/10.1145/3584931.3606994

Liu, Linyi ; Yang, Siqi ; Wang, Yixue et al. / Robotic Systems in Heritage Protection: An Anti-Fatigue Human-Robot Collaboration Exploration for Heritage Painting and Calligraphy Restoration. CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing. editor / Morgan Ames ; Susan Fussell ; Eric Gilbert ; Vera Liao ; Xiaojuan Ma ; Xinru Page ; Mark Rouncefield ; Vivek Singh ; Pamela Wisniewski. Association for Computing Machinery (ACM), 2023. pp. 201–205 (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW).

@inproceedings{224771ac66a44fc799288fae24e3746e,

title = "Robotic Systems in Heritage Protection: An Anti-Fatigue Human-Robot Collaboration Exploration for Heritage Painting and Calligraphy Restoration",

abstract = "The heritage restoration of paintings and calligraphy is a labour-intensive process, characterised by repetitive, low-intensity, and high-precision. Two core steps, “lift up the previous” and “fix and maintain”, can lead to muscle fatigue in the upper limbs. In this paper, we develop a human-in-the-loop based human-robot collaboration system that provides real-time force feedback to restorers based on their muscle load and motion intention, with the support strength changing to relieve fatigue. Different robot-aided positions on human arm are explored and a two-point elbow-supporting mechanism is evaluated as the optimal solution. Moreover, a novel muscle load calculation model is developed to integrate human factors into the HRC system with electromyography. The results of a usability experiment show the effectiveness of the proposed method in addressing the current anti-fatigue challenge in heritage paintings and calligraphy restoration.",

keywords = "Anti-Fatigue, Electromyography, Heritage Restoration, Human-Robot Collaboration",

author = "Linyi Liu and Siqi Yang and Yixue Wang and Zhengtao Ma and Le Fang and Yonghao Long and Wang, {Stephen Jia}",

note = "Publisher Copyright: {\textcopyright} 2023 ACM.",

year = "2023",

month = oct,

day = "14",

doi = "10.1145/3584931.3606994",

language = "English",

series = "Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW",

publisher = "Association for Computing Machinery (ACM)",

pages = "201–205",

editor = "Morgan Ames and Susan Fussell and Eric Gilbert and Vera Liao and Xiaojuan Ma and Xinru Page and Mark Rouncefield and Vivek Singh and Pamela Wisniewski",

booktitle = "CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing",

address = "United States",

}

Liu, L, Yang, S, Wang, Y, Ma, Z, Fang, L, Long, Y & Wang, SJ 2023, Robotic Systems in Heritage Protection: An Anti-Fatigue Human-Robot Collaboration Exploration for Heritage Painting and Calligraphy Restoration. in M Ames, S Fussell, E Gilbert, V Liao, X Ma, X Page, M Rouncefield, V Singh & P Wisniewski (eds), CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing. Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW, Association for Computing Machinery (ACM), pp. 201–205. https://doi.org/10.1145/3584931.3606994

Robotic Systems in Heritage Protection: An Anti-Fatigue Human-Robot Collaboration Exploration for Heritage Painting and Calligraphy Restoration. / Liu, Linyi; Yang, Siqi; Wang, Yixue et al.
CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing. ed. / Morgan Ames; Susan Fussell; Eric Gilbert; Vera Liao; Xiaojuan Ma; Xinru Page; Mark Rouncefield; Vivek Singh; Pamela Wisniewski. Association for Computing Machinery (ACM), 2023. p. 201–205 (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW).

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

TY - GEN

T1 - Robotic Systems in Heritage Protection: An Anti-Fatigue Human-Robot Collaboration Exploration for Heritage Painting and Calligraphy Restoration

AU - Liu, Linyi

AU - Yang, Siqi

AU - Wang, Yixue

AU - Ma, Zhengtao

AU - Fang, Le

AU - Long, Yonghao

AU - Wang, Stephen Jia

PY - 2023/10/14

Y1 - 2023/10/14

N2 - The heritage restoration of paintings and calligraphy is a labour-intensive process, characterised by repetitive, low-intensity, and high-precision. Two core steps, “lift up the previous” and “fix and maintain”, can lead to muscle fatigue in the upper limbs. In this paper, we develop a human-in-the-loop based human-robot collaboration system that provides real-time force feedback to restorers based on their muscle load and motion intention, with the support strength changing to relieve fatigue. Different robot-aided positions on human arm are explored and a two-point elbow-supporting mechanism is evaluated as the optimal solution. Moreover, a novel muscle load calculation model is developed to integrate human factors into the HRC system with electromyography. The results of a usability experiment show the effectiveness of the proposed method in addressing the current anti-fatigue challenge in heritage paintings and calligraphy restoration.

AB - The heritage restoration of paintings and calligraphy is a labour-intensive process, characterised by repetitive, low-intensity, and high-precision. Two core steps, “lift up the previous” and “fix and maintain”, can lead to muscle fatigue in the upper limbs. In this paper, we develop a human-in-the-loop based human-robot collaboration system that provides real-time force feedback to restorers based on their muscle load and motion intention, with the support strength changing to relieve fatigue. Different robot-aided positions on human arm are explored and a two-point elbow-supporting mechanism is evaluated as the optimal solution. Moreover, a novel muscle load calculation model is developed to integrate human factors into the HRC system with electromyography. The results of a usability experiment show the effectiveness of the proposed method in addressing the current anti-fatigue challenge in heritage paintings and calligraphy restoration.

KW - Anti-Fatigue

KW - Electromyography

KW - Heritage Restoration

KW - Human-Robot Collaboration

UR - http://www.scopus.com/inward/record.url?scp=85176252122&partnerID=8YFLogxK

U2 - 10.1145/3584931.3606994

DO - 10.1145/3584931.3606994

M3 - Conference article published in proceeding or book

T3 - Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

SP - 201

EP - 205

BT - CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing

A2 - Ames, Morgan

A2 - Fussell, Susan

A2 - Gilbert, Eric

A2 - Liao, Vera

A2 - Ma, Xiaojuan

A2 - Page, Xinru

A2 - Rouncefield, Mark

A2 - Singh, Vivek

A2 - Wisniewski, Pamela

PB - Association for Computing Machinery (ACM)

ER -

Liu L, Yang S, Wang Y, Ma Z, Fang L, Long Y et al. Robotic Systems in Heritage Protection: An Anti-Fatigue Human-Robot Collaboration Exploration for Heritage Painting and Calligraphy Restoration. In Ames M, Fussell S, Gilbert E, Liao V, Ma X, Page X, Rouncefield M, Singh V, Wisniewski P, editors, CSCW 2023 Companion - Conference Companion Publication of the 2023 Computer Supported Cooperative Work and Social Computing. Association for Computing Machinery (ACM). 2023. p. 201–205. (Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW). doi: 10.1145/3584931.3606994

Robotic Systems in Heritage Protection: An Anti-Fatigue Human-Robot Collaboration Exploration for Heritage Painting and Calligraphy Restoration

Abstract

Publication series

Keywords

ASJC Scopus subject areas

More information

Other files and links

Fingerprint

Cite this