A Markerless AR Guidance Method for Large-Scale Wire and Cable Laying of Electromechanical Products

Geng, Junhao1; Chen, Mengbo1; Zhao, Xinyang1; Liu, Yu2; Ma, Yongsheng3

2023-10-01

10.1109/TII.2023.3316228

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS   Impact Factor & Quartile

1551-3203

1941-0050

Large-scale wires and cables (W&Cs) are the nerves of large and complex electromechanical products vital to their regular operation. The laying process of W&C has been highly dependent on manual work and urgently needs intelligent guidance like augmented reality (AR). However, model registration and occlusion handling based on AR for large-scale W&C laying scenes cannot achieve high-quality results to date because of the lack of texture, the local field of vision, and other characteristics. Therefore, a markerless AR guidance method for large-scale W&C laying is proposed to address this long-lasting problem. First, camera, ultrawideband, and inertial measurement unit sensors are integrated to coarsely register the W&C models based on coordinate transformation and mapping virtual and physical spaces. Then, a local edge matching method is used to register the W&C models based on the coarse one finely. Next, the occlusion relationships of the W&C models are handled based on assembly constraints; the models are anchored in the simultaneous localization and mapping map for visual and continuous guidance. A locomotive W&C laying case study and evaluation results show that this method meets industrial application requirements regarding efficiency, accuracy, and robustness and has several advantages compared to other methods, including extra-large scale, automatic registration, and virtual-real fusion.

Large scale wire and cable (W&C) laying markerless augmented reality (AR) guidance model registration occlusion handling

SCI

English

Others

National Natural Science Foundation of China[52175484]

Automation & Control Systems ; Computer Science ; Engineering

Automation & Control Systems ; Computer Science, Interdisciplinary Applications ; Engineering, Industrial

WOS:001082508900001

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

Web of Science

1.Northwestern Polytech Univ, Sch Mech Engn, Xian 710072, Peoples R China
2.CRRC Acad, Dept Intelligent Mfg, Beijing 100160, Peoples R China
3.Coll Engn, SUSTech, Shenzhen 518055, Peoples R China

Geng, Junhao,Chen, Mengbo,Zhao, Xinyang,et al. A Markerless AR Guidance Method for Large-Scale Wire and Cable Laying of Electromechanical Products[J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,2023.

Geng, Junhao,Chen, Mengbo,Zhao, Xinyang,Liu, Yu,&Ma, Yongsheng.(2023).A Markerless AR Guidance Method for Large-Scale Wire and Cable Laying of Electromechanical Products.IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS.

Geng, Junhao,et al."A Markerless AR Guidance Method for Large-Scale Wire and Cable Laying of Electromechanical Products".IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2023).