Inspection of Wind Turbine Blades Using Image Deblurring and Deep Learning Segmentation

Jiale Lu, Qingbin Gao, Kai Zhou

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

Abstract

Remote and complex work sites of wind turbines limit the accessibility of the condition assessment. Wind turbine blades are subject to sustained wind load and harsh natural environmental conditions, which are vulnerable to various faults. Robotic-enabled sensing technology appears to be a promising solution for an efficient wind turbine blade inspection. Together with the recent advances in image processing and deep learning segmentation, automated inspection of wind turbine blades becomes possible. Nevertheless, it remains a challenging task to quantify the damage accurately due to the complex condition of images concerning motion blurs. To address this issue, an integrated framework, i.e., the combination of a Deblur Generative Adversarial Network v2 (DeblurGAN-v2) and You Only Look Once v8 (YOLO-v8) was proposed in this study. Specifically, the mapping between the motion-blurred images and those in high quality was adopted from the open-access pretrained DeblurGAN-v2, based on which the deblurring performance for wind turbine images with various motion blur scales was discussed concerning the image quality. Subsequently, the transfer learning method was implemented to fine-tune YOLO-v8. The well-trained YOLO v8 was then utilized for target defect segmentation on the deblurred images. Finally, various metrics were calculated to evaluate the segmentation accuracy and efficiency. Results prove a good generalization of DeblurGAN-v2 on wind turbine images and clearly illustrate the enhanced performance of the proposed methodology especially when the motion blur scale is within 35. The integrated framework could serve as a reference for dealing with other fuzzy image-related issues.

Original languageEnglish
Title of host publicationHealth Monitoring of Structural and Biological Systems XVIII
EditorsZhongqing Su, Kara J. Peters, Fabrizio Ricci, Piervincenzo Rizzo
PublisherSPIE
ISBN (Electronic)9781510672086
DOIs
Publication statusPublished - 2024
EventHealth Monitoring of Structural and Biological Systems XVIII 2024 - Long Beach, United States
Duration: 25 Mar 202428 Mar 2024

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12951
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceHealth Monitoring of Structural and Biological Systems XVIII 2024
Country/TerritoryUnited States
CityLong Beach
Period25/03/2428/03/24

Keywords

  • Deblur Generative Adversarial Network v2 (DeblurGAN-v2)
  • Defect segmentation
  • Image deblurring
  • Robotic-enabled sensing
  • Wind turbine blades
  • You Only Look Once (YOLO)

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Inspection of Wind Turbine Blades Using Image Deblurring and Deep Learning Segmentation'. Together they form a unique fingerprint.

Cite this