TY - GEN
T1 - Seed Feature Maps-based CNN Models for LEO Satellite Remote Sensing Services
AU - Lu, Zhichao
AU - Ding, Chuntao
AU - Wang, Shangguang
AU - Cheng, Ran
AU - Juefei-Xu, Felix
AU - Boddeti, Vishnu Naresh
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Deploying high-performance convolutional neural network (CNN) models on low-earth orbit (LEO) satellites for rapid remote sensing image processing has attracted significant interest from industry and academia. However, the limited resources available on LEO satellites contrast with the demands of resource-intensive CNN models, necessitating the adoption of ground-station server assistance for training and updating these models. Existing approaches often require large floating-point operations (FLOPs) and substantial model parameter transmissions, presenting considerable challenges. To address these issues, this paper introduces a ground-station server-assisted framework. With the proposed framework, each layer of the CNN model contains only one learnable feature map (called the seed feature map) from which other feature maps are generated based on specific rules. The hyperparameters of these rules are randomly generated instead of being trained, thus enabling the generation of multiple feature maps from the seed feature map and significantly reducing FLOPs. Furthermore, since the random hyperparameters can be saved using a few random seeds, the ground station server assistance can be facilitated in updating the CNN model deployed on the LEO satellite. Experimental results on the ISPRS Vaihingen, ISPRS Potsdam, UAVid, and LoveDA datasets for semantic segmentation services demonstrate that the proposed framework outperforms existing state-of-the-art approaches. In particular, the SineFM-based model achieves a higher mIoU than the UNetFormer on the UAVid dataset, with 3.3 × fewer parameters and 2.2 × fewer FLOPs.
AB - Deploying high-performance convolutional neural network (CNN) models on low-earth orbit (LEO) satellites for rapid remote sensing image processing has attracted significant interest from industry and academia. However, the limited resources available on LEO satellites contrast with the demands of resource-intensive CNN models, necessitating the adoption of ground-station server assistance for training and updating these models. Existing approaches often require large floating-point operations (FLOPs) and substantial model parameter transmissions, presenting considerable challenges. To address these issues, this paper introduces a ground-station server-assisted framework. With the proposed framework, each layer of the CNN model contains only one learnable feature map (called the seed feature map) from which other feature maps are generated based on specific rules. The hyperparameters of these rules are randomly generated instead of being trained, thus enabling the generation of multiple feature maps from the seed feature map and significantly reducing FLOPs. Furthermore, since the random hyperparameters can be saved using a few random seeds, the ground station server assistance can be facilitated in updating the CNN model deployed on the LEO satellite. Experimental results on the ISPRS Vaihingen, ISPRS Potsdam, UAVid, and LoveDA datasets for semantic segmentation services demonstrate that the proposed framework outperforms existing state-of-the-art approaches. In particular, the SineFM-based model achieves a higher mIoU than the UNetFormer on the UAVid dataset, with 3.3 × fewer parameters and 2.2 × fewer FLOPs.
KW - CNN
KW - nonlinear transformation
KW - random seed
KW - Remote sensing services
KW - seed feature maps
UR - https://www.scopus.com/pages/publications/85173899057
U2 - 10.1109/ICWS60048.2023.00060
DO - 10.1109/ICWS60048.2023.00060
M3 - Conference article published in proceeding or book
AN - SCOPUS:85173899057
T3 - Proceedings - 2023 IEEE International Conference on Web Services, ICWS 2023
SP - 415
EP - 425
BT - Proceedings - 2023 IEEE International Conference on Web Services, ICWS 2023
A2 - Ardagna, Claudio
A2 - Benatallah, Boualem
A2 - Bian, Hongyi
A2 - Chang, Carl K.
A2 - Chang, Rong N.
A2 - Fan, Jing
A2 - Fox, Geoffrey C.
A2 - Jin, Zhi
A2 - Liu, Xuanzhe
A2 - Ludwig, Heiko
A2 - Sheng, Michael
A2 - Yang, Jian
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2023 IEEE International Conference on Web Services, ICWS 2023
Y2 - 2 July 2023 through 8 July 2023
ER -