Whistle detection and classification for whales based on convolutional neural networks

Passive acoustic observation of whales is an increasingly important tool for whale research. Accurately detecting whale sounds and correctly classifying them into corresponding whale species are essential tasks, especially in the case when two species of whales vocalize in the same observed area. Whistles are vital vocalizations of toothed whales, such as killer whales and long-finned pilot whales. In this paper, based on deep convolutional neural networks (CNNs), a novel method is proposed to detect and classify whistles of both killer whales and long-finned pilot whales. Compared with traditional methods, the proposed one can automatically learn the sound characteristics from the training data, without specifying the sound features for classification and detection, and thus shows better adaptability to complex sound signals. First, the denoised sound to be analyzed is sent to the trained detection model to estimate the number and positions of the target whistles. The detected whistles are then sent to the trained classification model, which determines the corresponding whale species. A GUI interface is developed to assist with the detection and classification process. Experimental results show that the proposed method can achieve 97% correct detection rate and 95% correct classification rate on the testing set. In the future, the presented method can be further applied to passive acoustic observation applications for some other whale or dolphin species.