Estimating construction workers’ physical workload by fusing computer vision and smart insole technologies

Yantao Yu, Heng Li, Xincong Yang, Waleed Umer

Research output: Unpublished conference presentation (presented paper, abstract, poster)Conference presentation (not published in journal/proceeding/book)Academic researchpeer-review

3 Citations (Scopus)

Abstract

Construction workers are commonly subjected to ergonomic risks due to awkward postures and/or excessive manual material handling. Accurate ergonomic assessment will facilitate ergonomic risk identification and the subsequent mitigation. Traditional assessment methods such as visual observation and on-body sensors rely on subjective judgement and are intrusive in nature. To cope up with the limitations of the existing technologies, a computer vision and smart insole-based joint-level ergonomic workload calculation methodology is proposed for construction workers. Accordingly, this method could provide an objective and detailed ergonomic assessment for various construction tasks. Firstly, construction workers’ skeleton data is extracted using a smartphone camera with an advanced deep learning algorithm. Secondly, smart insoles are used to quantify the plantar pressures while the worker performs a construction activity. Finally, the gathered data is fed to an inverse dynamic model in order to calculate the joint torques and workloads. The aforementioned approach was tested with experiments comprising simulations of material handling, plastering and rebar. The results reveal that the developed methodology has the potential to provide detailed and accurate ergonomic assessment. Overall, this research contributes to the knowledge of occupational safety and health in construction management by providing a novel approach to assess the risk factors of work-related musculoskeletal disorders (WMSDs).

Original languageEnglish
Publication statusPublished - 1 Jan 2018
Event35th International Symposium on Automation and Robotics in Construction and International AEC/FM Hackathon: The Future of Building Things, ISARC 2018 - Berlin, Germany
Duration: 20 Jul 201825 Jul 2018

Conference

Conference35th International Symposium on Automation and Robotics in Construction and International AEC/FM Hackathon: The Future of Building Things, ISARC 2018
Country/TerritoryGermany
CityBerlin
Period20/07/1825/07/18

Keywords

  • Construction worker
  • Deep learning
  • Machine learning
  • Occupational health
  • Safety

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Artificial Intelligence
  • Building and Construction

Cite this