PRAT: Accurate object tracking based on progressive attention

Zeng，Yulin1; Zeng，Bi1; Hu，Huiting2; Zhang，Hong3

2023-11-01

10.1016/j.engappai.2023.106988

Engineering Applications of Artificial Intelligence   Impact Factor & Quartile

0952-1976

1873-6769

Object tracking aims to estimate the position of a given object in subsequent video sequences. One of the research focuses in tracking is feature fusion as the similar response maps generated by feature fusion can significantly affect tracking accuracy. However, traditional naive correlation and depthwise correlation blur the spatial information and do not perform well in low resolution, similar objects, partial occlusion and other scenes. In this paper, we propose a progressive attention tracker called PRAT. It performs sufficient similarity learning between the template and search region to achieve more accurate object tracking. Specifically, PRAT performs self-enhancement on template features, and uses unidirectional cross enhancement and progressive enhancement to fuse template features into search features. Therefore, the search region features have the ability of target perception. In addition, we also design a convolution-based network to replace the FFN in the original Transformer to enhance local semantics. Experiments on six challenging benchmarks show that our PRAT achieves state-of-the-art performance. Particularly, on the challenging UAV123, PRAT sets a new record with 0.703 SUC score. PRAT runs at 63 fps on GPU.

Feature fusion Object tracking Progressive attention Real-time Unidirectional enhancement

SCI

English

Others

National Natural Science Foundation of China[62172111];National Natural Science Foundation of China[U21A20478];

Automation & Control Systems ; Computer Science ; Engineering

Automation & Control Systems ; Computer Science, Artificial Intelligence ; Engineering, Multidisciplinary ; Engineering, Electrical & Electronic

WOS:001073726800001

PERGAMON-ELSEVIER SCIENCE LTD

ENGINEERING

2-s2.0-85169050797

Scopus

1.School of Computer Science and Technology,Guangdong University of Technology,Guangzhou,510006,China
2.School of Information Science and Technology,Zhongkai University of Agriculture and Engineering,Guangzhou,510225,China
3.Department of Electronic and Electrical Engineering,Southern University of Science and Technology,Shenzhen,518055,China

Zeng，Yulin,Zeng，Bi,Hu，Huiting,et al. PRAT: Accurate object tracking based on progressive attention[J]. Engineering Applications of Artificial Intelligence,2023,126.

Zeng，Yulin,Zeng，Bi,Hu，Huiting,&Zhang，Hong.(2023).PRAT: Accurate object tracking based on progressive attention.Engineering Applications of Artificial Intelligence,126.

Zeng，Yulin,et al."PRAT: Accurate object tracking based on progressive attention".Engineering Applications of Artificial Intelligence 126(2023).