A deep learning-based method for detecting non-certified work on construction sites

Qi Fang, Heng Li, Xiaochun Luo, Lieyun Ding, Timothy M. Rose, Wangpeng An, Yantao Yu

Research output: Journal article publicationJournal articleAcademic researchpeer-review

118 Citations (Scopus)


The construction industry is a high hazard industry. Accidents frequently occur, and part of them are closely relate to workers who are not certified to carry out specific work. Although workers without a trade certificate are restricted entry to construction sites, few ad-hoc approaches have been commonly employed to check if a worker is carrying out the work for which they are certificated. This paper proposes a novel framework to check whether a site worker is working within the constraints of their certification. Our framework comprises key video clips extraction, trade recognition and worker competency evaluation. Trade recognition is a new proposed method through analyzing the dynamic spatiotemporal relevance between workers and non-worker objects. We also improved the identification results by analyzing, comparing, and matching multiple face images of each worker obtained from videos. The experimental results demonstrate the reliability and accuracy of our deep learning-based method to detect workers who are carrying out work for which they are not certified to facilitate safety inspection and supervision.

Original languageEnglish
Pages (from-to)56-68
Number of pages13
JournalAdvanced Engineering Informatics
Publication statusPublished - 1 Jan 2018


  • Certification checking
  • Construction safety
  • Deep learning
  • Identification
  • Trade recognition

ASJC Scopus subject areas

  • Information Systems
  • Artificial Intelligence


Dive into the research topics of 'A deep learning-based method for detecting non-certified work on construction sites'. Together they form a unique fingerprint.

Cite this