TY - GEN
T1 - Drone-Based Tower Survey by Multi-Task Learning
AU - Sami, Mirza Tanzim
AU - Yan, Da
AU - Huang, Huang
AU - Liang, Xinyu
AU - Guo, Guimu
AU - Jiang, Zhe
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Various industries use towers as part of their daily operations, such as transmission towers (aka. electricity pylons), telecommunications towers and water towers. These towers re- quire regular maintenance, and before the maintenance work can be done, a preliminary survey must be conducted to determine where to work. More and more, such surveys are being conducted via drones. This work develops a detection model to help locate tower issues from the video frames of drones. However, it does not provide satisfactory performance to directly train such an object detection model with the annotated problem locations from domain experts. Therefore, we propose to improve the quality of the extracted image features with the help of another separate task which detects the various parts that are involved in the tower issues, such as bolts, nuts, washers and pins, the annotations of which can be done without the need of domain expertise. Through this multi-task learning scheme, we improved the problem detection recall from 59.6% to 71.5%, providing much more effective recommendations of potential issues for inspectors to examine further. Also, the average number of problem detections in each image is merely 5.54 so inspectors are not overwhelmed by the recommended locations.
AB - Various industries use towers as part of their daily operations, such as transmission towers (aka. electricity pylons), telecommunications towers and water towers. These towers re- quire regular maintenance, and before the maintenance work can be done, a preliminary survey must be conducted to determine where to work. More and more, such surveys are being conducted via drones. This work develops a detection model to help locate tower issues from the video frames of drones. However, it does not provide satisfactory performance to directly train such an object detection model with the annotated problem locations from domain experts. Therefore, we propose to improve the quality of the extracted image features with the help of another separate task which detects the various parts that are involved in the tower issues, such as bolts, nuts, washers and pins, the annotations of which can be done without the need of domain expertise. Through this multi-task learning scheme, we improved the problem detection recall from 59.6% to 71.5%, providing much more effective recommendations of potential issues for inspectors to examine further. Also, the average number of problem detections in each image is merely 5.54 so inspectors are not overwhelmed by the recommended locations.
UR - http://www.scopus.com/inward/record.url?scp=85125296200&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85125296200&partnerID=8YFLogxK
U2 - 10.1109/BigData52589.2021.9672078
DO - 10.1109/BigData52589.2021.9672078
M3 - Conference contribution
AN - SCOPUS:85125296200
T3 - Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021
SP - 6011
EP - 6013
BT - Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021
A2 - Chen, Yixin
A2 - Ludwig, Heiko
A2 - Tu, Yicheng
A2 - Fayyad, Usama
A2 - Zhu, Xingquan
A2 - Hu, Xiaohua Tony
A2 - Byna, Suren
A2 - Liu, Xiong
A2 - Zhang, Jianping
A2 - Pan, Shirui
A2 - Papalexakis, Vagelis
A2 - Wang, Jianwu
A2 - Cuzzocrea, Alfredo
A2 - Ordonez, Carlos
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2021 IEEE International Conference on Big Data, Big Data 2021
Y2 - 15 December 2021 through 18 December 2021
ER -