A novel traffic sign recognition approach for open scenarios 面向开放场景的交通标志识别方法

Cao，Weipeng1; Wu，Yuhao1; Li，Dachuan2; Ming，Zhong1; Chen，Zhenru1; Ye，Xuan1

2023-05-01

10.3724/SP.J.1249.2023.03258

Shenzhen Daxue Xuebao (Ligong Ban)/Journal of Shenzhen University Science and Engineering   Impact Factor & Quartile

1000-2618

Traffic sign recognition systems based on the traditional deep learning technologies typically follow the complete data-driven mode, resulting in their unstable performances and significant security risks when applied to the real-world open scenarios. To alleviate this problem, a novel method is proposed by constructing the semantic data set based on road traffic sign design standards and using the zero-shot learning (ZSL) mechanism to develop a general TSR framework with reasoning and interpretation capabilities. This method can effectively overcome the problems of dynamic update of road traffic signs and classes missing in practice. Furthermore, the national standard for road traffic signs is used to abstract the general attributes of all classes and then the information is injected into the training process of traditional data-driven model as domain knowledge. With the help of domain knowledge, the proposed ZSL-based TSR method can recognize traffic signs that have not been seen in the training stage more accurately than random prediction and traditional deep learning models. Experimental results on the Chinese traffic sign database (CTSDB) and the German traffic sign recognition benchmark (GTSRB) demonstrate that our method, which trains a semantic auto-encoder model, can significantly improve the accuracy in traditional zero-shot learning settings. Specifically, when identifying previously unseen traffic signs in the training set, our approach achieves an improvement in accuracy of at least 29. 96% and 24. 25% on CTSDB and GTSRB, respectively, compared to random prediction. The study verifies the feasibility and effectiveness of the proposed scheme.

artificial intelligence assisted driving autonomous driving deep learning open scenarios traffic sign recognition zero-shot learning

Chinese

Others

2-s2.0-85162734764

Scopus

1.Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ),Shenzhen,Guangdong Province,518107,China
2.Research Institute of Trustworthy Autonomous System,Southern University of Science and Technology,Shenzhen,Guangdong Province,518055,China

Cao，Weipeng,Wu，Yuhao,Li，Dachuan,等. A novel traffic sign recognition approach for open scenarios 面向开放场景的交通标志识别方法[J]. Shenzhen Daxue Xuebao (Ligong Ban)/Journal of Shenzhen University Science and Engineering,2023,40(3):258-265.

Cao，Weipeng,Wu，Yuhao,Li，Dachuan,Ming，Zhong,Chen，Zhenru,&Ye，Xuan.(2023).A novel traffic sign recognition approach for open scenarios 面向开放场景的交通标志识别方法.Shenzhen Daxue Xuebao (Ligong Ban)/Journal of Shenzhen University Science and Engineering,40(3),258-265.

Cao，Weipeng,et al."A novel traffic sign recognition approach for open scenarios 面向开放场景的交通标志识别方法".Shenzhen Daxue Xuebao (Ligong Ban)/Journal of Shenzhen University Science and Engineering 40.3(2023):258-265.