Active Learning-DETR: Cost-Effective Object Detection for Kitchen Waste

  • Hai Qin
  • , Liye Shu
  • , Li Zhou
  • , Songyun Deng
  • , Haihua Xiao
  • , Wei Sun
  • , Qiaokang Liang
  • , Dan Zhang
  • , Yaonan Wang

Research output: Journal article publicationJournal articleAcademic researchpeer-review

11 Citations (Scopus)

Abstract

Object detection in kitchen waste faces numerous challenges, including a variety of target categories, significant morphological variations, and complex backgrounds, coupled with the scarcity of targeted datasets, resulting in limited research in this area. In response to these challenges, we integrate insights from real-world industrial scenarios of kitchen waste sorting and create, for the first time, a dataset comprising eight categories specifically designed for kitchen waste object detection. Furthermore, we initiate the integration of active learning (AL) methods into the object detection transformer (DETR) network, proposing the AL-DETR model - a high-precision detection model tailored for scenarios with limited samples. To overcome the drawback of DETR, which relies on a large amount of annotated data for training, we employ an AL strategy, annotating challenging samples with high uncertainty selected from a pool of unlabeled data, and integrating them back into the training set to enhance the model's learning capability. AL-DETR also models non-local visual correlations between labeled and unlabeled samples, comparing differences in detection categories to identify relevant unlabeled samples. Additionally, we establish a robotic sorting platform with an end-effector integrating gripping and suction functionalities, accompanied by the development of visual detection and robot control software. The experimental results indicate that, in the dataset constructed for this study, which primarily focuses on detecting large objects, our approach achieves a minimum improvement of 9.23% compared to other methods, reaching state-of-the-art (SOTA) performance. Additionally, our method surpasses other AL approaches using the entire annotated dataset by more than 1.01% in mAP when the original dataset's annotation data is only 82.5%. In practical testing, the sorting platform successfully accomplishes efficient detection and sorting of kitchen waste.

Original languageEnglish
Article number2509115
Pages (from-to)1-15
Number of pages15
JournalIEEE Transactions on Instrumentation and Measurement
Volume73
DOIs
Publication statusPublished - Feb 2024

Keywords

  • Active learning (AL)
  • kitchen waste images
  • object detection
  • robotic sorting
  • transformer

ASJC Scopus subject areas

  • Instrumentation
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Active Learning-DETR: Cost-Effective Object Detection for Kitchen Waste'. Together they form a unique fingerprint.

Cite this