FORENSIC ANALYSIS OF DRONE COLLISION WITH TRANSFER LEARNING


(Received: 13-Jan.-2023, Revised: 19-Mar.-2023 , Accepted: 4-May-2023)
Drones are among the devices that are used in many different activities. There is a time when drones have accidents and authorities need to find the cause. Drone forensics is used to determine the cause of an accident. The analysis phase of drone forensics is one of the most important steps in determining accident causes. In this paper, we applied a deep-learning technique to classify drone collisions. We investigate the use of Inception V.9 as the deep-learning framework. Additionally, this study compares the performance of the proposed method with other techniques, such as MobileNet, VGG and ResNet, in classifying drone collisions. In this experiment, we also implement transfer learning as well as its fine tuning to speed up the training process and to improve the accuracy value. Additionally, our investigation shows that Inception V.9 outperforms other frameworks in terms of accuracy, precision and F1 score.

[1] L. P. Osco et al., "A Review on Deep Learning in UAV Remote Sensing," Int. J. of Applied Earth Observation and Geoinformation, vol. 102, p. 102456, 2021.

[2] A. L. Renduchintala, A. Albehadili and A. Y. Javaid, "Drone Forensics: Digital Flight Log Examination Framework for Micro Drones," Proc. of the 2017 Int. Conf. on Computational Science and Computational Intelligence (CSCI 2017), pp. 91-96, DOI: 10. 1109/CSCI. 2017. 15, 2018.

[3] G. Horsman, "Unmanned Aerial Vehicles: A Preliminary Analysis of Forensic Challenges," Digital Investigation, vol. 16, pp. 1-11, DOI: 10.1016/j .diin.2015.11.002, 2016.

[4] D. Pedro et al., "Collision Avoidance on Unmanned Aerial Vehicles Using Neural Network Pipelines and Flow Clustering Techniques," Remote Sensing, vol. 13, DOI: 10.3390/rs13132643, 2021.

[5] U. Jain, M. Rogers and E. T. Matson, "Drone Forensic Framework: Sensor and Data Identification and Verification," Proc. of the 2017 IEEE Sensors Applications Symposium (SAS), pp. l-6, DOI: 10. 1109/SAS. 2017.7894059, 2017.

[6] M. W. Ashraf, W. Sultani and M. Shah, "Dogfight: Detecting Drones from Drones Videos," CVPR, The Computer Vision Foundation, pp. 7063- 7072, DOI: 10.1109/CVPR46437.2021.00699, 2021.

[7] C. Szegedy, S. Ioffe, V. Vanhoucke and A. Alemi, "Inception-v4, Inception-resnet and the Impact of Residual Connections on Learning," Proc. of the 31st AAAI Conf. on Artificial Intelligence (AAAI’17), pp. 4278-4284, DOI: 10.48550.arXiv.1602.07261, 2016.

[8] A. Anwar and A. Raychowdhury, "Autonomous Navigation via Deep Reinforcement Learning for Resource Constraint Edge Nodes Using Transfer Learning," IEEE Access, vol. 8, pp. 26549-26560, DOI: 10 .1109/ACCESS.2020.2971 172, 2020.

[9] S. Ouahouah et al., "Deep-reinforcement-learning-based Collision Avoidance in UAV Environment," IEEE Internet of Things Journal, vol. 9, no. 6, pp. 4015-4030, DOI: 10.1109/JIOT.2021.3118949, 2022.

[10] A. A. Obaid and H. Koyuncu, "Obstacle Avoidance in Unmanned Aerial Vehicles Using Image Segmentation and Deep Learning," Proc. of the 2022 Int. Symposium on Multi-disciplinary Studies and Innovative Technologies (ISMSIT), pp. 912-915, DOI: 10.1109/ISMSIT56059. 2022.9932865, 2022.

[11] F. Rehmatullah and J. Kelly, "Vision-based Collision Avoidance for Personal Aerial Vehicles Using Dynamic Potential Fields," Proc. of the 12th Conf. on Computer and Robot Vision (CRY 2015), pp. 297-304, DOI: 10.1109/CRV.2015.46, 2015.

[12] R. R. Lima and G. A. S. Pereira, "Drone Collision Detection and Classification Using Proprioceptive Data," Proc. of the Int. Conf. on Unmanned Aircraft Systems (ICUAS), pp. 562-569, DOI: 10.1109/ICUAS54217.2022.9836207, 2022.

[13] J. K. Park et al., "UAV Collision Detection Algorithm Based on Formula for Fast Calculation," Turkish J. of Computer and Mathematics Education (TURCOMAT), vol. 12, no. 6, pp. 452-456, 2021.

[14] A. Weinert, L. Alvarez, M. Owen and B. Zintak, "Near Midair Collision Analog for Drones Based on Unmitigated Collision Risk," J. of Air Transportation, vol. 30, no. 2, pp. 37-48, 2022.

[15] X. Lu, X. Liu, Y. Li, Y. Zhang and H. Zuo, "Simulations of Airborne Collisions between Drones and an Aircraft Windshield," Aerospace Science and Technology, vol. 98, p. 105713, DOI: 10.1016/j.ast.2020 .105713, 2020.

[16] N. Zhang, H. Liu, B. F. Ng and K. H. Low, "Collision Probability between Intruding Drone and Commercial Aircraft in Airport Restricted Area Based on Collision-course Trajectory Planning," Transportation Research Part C: Emerging Technologies, vol. 120, p. 102736, DOI: 10.1016/j.trc.2020.102736, 2020.

[17] J. N. Yasin et al., "Formation Maintenance and Collision Avoidance in a Swarm of Drones," Proc. of the 3rd Int. Symp. on Computer Science and Intelligent Control, ACM, DOI: 10.1145/3386164. 3386176, 2019.

[18] B. Sabetghadam, R. Cunha and A. Pascoal, "A Distributed Algorithm for Real-time Multi-drone Collisionfree Trajectory Replanning," Sensors, vol. 22, no. 5, DOI: 10.3390/s22051855, 2022.

[19] S. J. Pan and Q. Yang, "A Survey on Transfer Learning," IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 10, pp. 1345-1359, 2010.

[20] S. Arakelyan, S. Arasteh, C. Hauser, E. Kline and A. Galstyan, "Bin2vec: Learning Representations of Binary Executable Programs for Security Tasks," Cybersecurity, vol. 4, no. 1, p. 26, DOI: 10.1186/s42400-021-00088-4, 2021.

[21] A. Ramdan et al., "Transfer Learning and Fine-tuning for Deep Learning-based Tea Diseases Detection on Small Datasets," Proc. of the 2020 Int. Conf. on Radar, Antenna, Microwave, Electronics and Telecommunications (ICRAMET), pp. 206-211,  DOI:10.1109/ICRAMET51080.2020 .9298575, 2020.

[22] J. Luttrell et al., "A deep Transfer Learning Approach to Fine-tuning Facial Recognition Models," Proc. of the 13th IEEE Conf. on Industrial Electronics and Applications (ICIEA), pp. 2671-2676, DOI: 10.1109/ICIEA. 2018.8398162, 2018.

[23] G. Vrbancic and V. Podgorelec, "Transfer Learning with Adaptive Fine-tuning," IEEE Access, vol. 8, pp. 196197-196211, DOI:10.1109/ACCESS.2020.3034343, 2020.

[24] M. Sandler, A. Howard, M. Zhu, A. Zhmoginov and L.-C. Chen, "Mobilenetv2: Inverted Residnals and Linear Bottlenecks, arXiv: 1801.04381, pp. 4510-4520, DOI: 10.1109/CVPR.2018.00474, 2018.

[25] C. Szegedy et al., "Rethinking the Inception Architecture for Computer Vision," Proc. of the 2016 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 2818-2826, DOI: 10.1109/CVPR.2016.308, 2016.

[26] K. He, X. Zhang, S. Ren and J. Sun, "Deep Residual Learning for Image Recognition," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770-778, DOI: 10.1109/CVPR.2016.90, 2016.

[27] J. Jaafari, S. Douzi, K. Douzi and B. Hssina, "Towards More Efficient CNN-based Surgical Tools Classification Using Transfer Learning," Journal of Big Data, vol. 8, DOI:10.1186/s40537-021-00509-8, 2021.

[28] G. Li, Z. Ji, Y. Chang, S. Li, X. Qu and D. Cao, "ML-ANet: A Transfer Learning Approach Using Adaptation Network for Multi-label Image Classification in Autonomous Driving," Chinese J. of Mechanical Engineering (English Edition), vol. 34, DOI: 10.1186/s10033-021-00598-9, 2021.

[29] H.-T. Theng, C.-C. Hsieh, W.-T. Lin and J.-T. Lin, "Deep Reinforcement Learning for Collision Avoidance of Autonomous Vehicle," Proc. of the 2020 IEEE Int. Conf. on Consumer Electronics-Taiwan (ICCETaiwan), DOI: 10. 1109/ICCE-Taiwan49838.2020.9258199, 2020.

[30] A. Sarkar and Kalyani, "Survey of Smart Grid Network Using Drone and PTZ Camera," Proc. of the 3rd Int. Conf. on 2019 Devices for Integrated Circuit (DevIC), Kalyani, India, 2019.

[31] C. Shorten and T. M. Khoshgoftaar, "A Survey on Image Data Augmentation for Deep Learning," Journal of Big Data, vol. 6, no. 1, p. 60, DOI: 10.1186/s40537-019-0197-0, 2019.

[32] N. Best, J. Ott and E. J. Linstead, "Exploring the Efficacy of Transfer Learning in Mining Image-based Software Artifacts," Journal of Big Data, vol. 7, DOI: 10.1186/s40537-020-00335-4, 2020.

[33] N. Attari, F. Ofli, M. Awad, J. Lucas and S. Chawla, "Nazr-CNN: Fine-grained Classification of UAV Imagery for Damage Assessment," Proc. of the 2017 Int. Conf. on Data Science and Advanced Analytics (DSAA 2017), pp. 50-59, DOI: 10.1109/DSAA.2017.72, 2017.

[34] W. Qiu, S. Bi, C. Zhong, Y. Luo, J. Li and B. Sun, "Obstacle Avoidance of Aerial Vehicle Based on Monocular Vision," Proc. of the 2017 IEEE 7th Annual Int. Conf. on CYBER Technology in Automation, Control and Intelligent Systems (CYBER), (2017) 657-662, DOI: 10.1109/CYBER.2017.8446065, 2017.

[35] L. Huang, X. Feng, C. Zhang, L. Qian and Y. Wu, "Deep Reinforcement Learning-based Joint Task Offloading and Bandwidth Allocation for Multi-user Mobile Edge Computing," Digital Communications and Networks, vol. 5, pp. 10-17, DOI:10.1016/j.dcan.2018.10.003, 2019.

[36] Y. Chen et al., "Classification Methods of a Small Sample Target Object in the Sky Based on the Higher Layer Visualizing Feature and Transfer Learning Deep Networks," EURASIP Journal on Wireless Communications and Networking, vol. 2018, no. 1, p. 127, DOI:10.1186/s13638-018-1133-2, 2018.

[37] B. Wei, L. Zhang, K. Wang, Q. Kong and Z. Wang, "Dynamic Scene Deblurring and Image De-raining Based on Generative Adversarial Networks and Transfer Learning for Internet of Vehicle," EURASIP J. on Advances in Signal Processing, vol. 2021, no. 1, p. 121, DOI: 10.1186/s13634-021-00829-0, 2021.

[38] Y.-H. Choi et al., "Using Deep Learning to Solve Computer Security Challenges: A Survey," Cybersecurity, vol. 3, no. 1, p. 15, DOI: 10.1186/s42400-020-00055-5, 2020.

[39] X. Chen, W. Qi and L. Xi, "Deep-learning-based Motion-correction Algorithm in Optical Resolution Photoacoustic Microscopy," Visual Computing for Industry, Biomedicine and Art, vol. 2, no. 1, p. 12, DOI:10.1186/s42492-019-0022-9, 2019.

[40] P. Drews-Jr, I. d. Souza, I. P. Maurell, E. V. Protas and S. S. C. Botelho, "Underwater Image Segmentation in the Wild Using Deep Learning," Journal of the Brazilian Computer Society, vol. 27, no. 1, p. 12, DOI: 10.1186/s13173-021-00117-7, 2021.