面向高分辨率遥感图像中复杂复合目标检测的关系感知部件学习

Relational Part-Aware Learning for Complex Composite Object Detection in High-Resolution Remote Sensing Images

IEEE Transactions on Cybernetics · 2024
被引 20
ABS 3

中文导读

提出关系感知部件网络(REPAN),通过部件区域提议、特征关系Transformer和上下文检测器,解决高分辨率遥感图像中复合目标(如燃煤电厂、港口)因部件布局多变导致的检测难题。

Abstract

In high-resolution remote sensing images (RSIs), complex composite object detection (e.g., coal-fired power plant detection and harbor detection) is challenging due to multiple discrete parts with variable layouts leading to complex weak inter-relationship and blurred boundaries, instead of a clearly defined single object. To address this issue, this article proposes an end-to-end framework, i.e., relational part-aware network (REPAN), to explore the semantic correlation and extract discriminative features among multiple parts. Specifically, we first design a part region proposal network (P-RPN) to locate discriminative yet subtle regions. With butterfly units (BFUs) embedded, feature-scale confusion problems stemming from aliasing effects can be largely alleviated. Second, a feature relation Transformer (FRT) plumbs the depths of the spatial relationships by part-and-global joint learning, exploring correlations between various parts to enhance significant part representation. Finally, a contextual detector (CD) classifies and detects parts and the whole composite object through multirelation-aware features, where part information guides to locate the whole object. We collect three remote sensing object detection datasets with four categories to evaluate our method. Consistently surpassing the performance of state-of-the-art methods, the results of extensive experiments underscore the effectiveness and superiority of our proposed method.

遥感图像处理目标检测深度学习计算机视觉