RESEARCH PAPER
Multi-sensor robotic mapping with thermal and acoustic imaging for non-contact technical diagnostics
1
Department of Robotics and Mechatronics, AGH University of Krakow, Poland
Submission date: 2025-11-20
Final revision date: 2025-12-19
Acceptance date: 2026-01-30
Online publication date: 2026-02-18
Corresponding author
Bartosz Hyla
Department of Robotics and Mechatronics, AGH University of Krakow, al A. Mickiewicza 30, 30-059, Kraków, Poland
Department of Robotics and Mechatronics, AGH University of Krakow, al A. Mickiewicza 30, 30-059, Kraków, Poland
KEYWORDS
TOPICS
ABSTRACT
Machine diagnostics is essential in maintaining high operational efficiency and minimizing machinery downtime. One way to achieve this goal is by implementing automated diagnostic systems. This paper presents a multi-sensor mapping system developed on a quadruped robotic platform. The robot combines diagnostic data from thermal and acoustic sensors with LiDAR data to create a 3D map of the working environment. Anomalous readings of temperature and sound pressure levels are identified and indicated on a 3D map with distinct color values through data fusion. Validation tests performed in a laboratory environment confirmed the feasibility of this approach by correctly identifying simulated cases of malfunctioning machinery. The system robustness was evaluated through repeatability tests. The proposed multi-modal mapping solution enables reliable monitoring of the technical state of machinery in complex environments.
REFERENCES (29)
1.
Abdo S, Hovanec M, Korba P, Svab P. Utilization of NDT methods in aircraft maintenance. 2021 New Trends in Aviation Development (NTAD), Košice, Slovakia, IEEE: 2021: 9–12, https://doi.org/10.1109/NTAD54....
2.
Belter D, Nowicki M R. Optimization-based legged odometry and sensor fusion for legged robot continuous localization. Robotics and Autonomous Systems 2019; 111: 110–124, https://doi.org/10.1016/j.robo....
3.
Bultmann S, Quenzel J, Behnke S. Real-time multi-modal semantic fusion on unmanned aerial vehicles with label propagation for cross-domain adaptation. Robotics and Autonomous Systems 2023; 159: 104286, https://doi.org/10.1016/j.robo....
4.
Chagoya J, Patel S, Koduru C et al. Data Collection, Heat Map Generation for Crack Detection Using Robotic Dog Fused with FLIR Sensor. SoutheastCon 2024, Atlanta, GA, USA, IEEE: 2024: 824–829, https://doi.org/10.1109/Southe....
5.
Cheng L, Gao H, Sun W et al. An Integrated Method for Predictive State Assessment and Path Planning for Inspection Robots in Island-Based Unmanned Substations. Eksploatacja i Niezawodność – Maintenance and Reliability 2025. doi:10.17531/ein/203994, https://doi.org/10.17531/ein/2....
6.
Dobrev Y, Flores S, Vossiek M. Multi-modal sensor fusion for indoor mobile robot pose estimation. 2016 IEEE/ION Position, Location and Navigation Symposium (PLANS), Savannah, GA, IEEE: 2016: 553–556, https://doi.org/10.1109/PLANS.....
7.
Fischer G K J, Bergau M, Gómez-Rosal D A et al. Evaluation of a Smart Mobile Robotic System for Industrial Plant Inspection and Supervision. IEEE Sensors Journal 2024; 24(12): 19684–19697, https://doi.org/10.1109/JSEN.2....
8.
Hamrani A, Rayhan M M, Mackenson T et al. Smart quadruped robotics: a systematic review of design, control, sensing and perception. Advanced Robotics 2025; 39(1): 3–29, https://doi.org/10.1080/016918....
9.
Khattak S, Nguyen H, Mascarich F et al. Complementary Multi–Modal Sensor Fusion for Resilient Robot Pose Estimation in Subterranean Environments. 2020 International Conference on Unmanned Aircraft Systems (ICUAS), Athens, Greece, IEEE: 2020: 1024–1029, https://doi.org/10.1109/ICUAS4....
10.
Khedekar N, Kulkarni M, Alexis K. MIMOSA: A Multi-Modal SLAM Framework for Resilient Autonomy against Sensor Degradation. 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, Japan, IEEE: 2022: 7153–7159, https://doi.org/10.1109/IROS47....
11.
Kubelka V, Reinstein M, Svoboda T. Improving multimodal data fusion for mobile robots by trajectory smoothing. Robotics and Autonomous Systems 2016; 84: 88–96, https://doi.org/10.1016/j.robo....
12.
Mączak J, Więcławski K, Szczurowski K. New approach of model based detection of early stages of fuel injector failures. Eksploatacja i Niezawodność – Maintenance and Reliability 2023. doi:10.17531/ein.2023.1.6, https://doi.org/10.17531/ein.2....
13.
Magalhaes P, Ferreira N. Inspection Application in an Industrial Environment with Collaborative Robots. Automation 2022; 3(2): 258–268, https://doi.org/10.3390/automa....
14.
Montes De Oca-Mora N J, Woo-Garcia R M, Juarez-Aguirre R et al. Mobile robot with failure inspection system for ferromagnetic structures using magnetic memory method. SN Applied Sciences 2021; 3(12): 853, https://doi.org/10.1007/s42452....
15.
Nam D V, Danh P T, Park C H, Kim G-W. Fusion consistency for industrial robot navigation: An integrated SLAM framework with multiple 2D LiDAR-visual-inertial sensors. Computers and Electrical Engineering 2024; 120: 109607, https://doi.org/10.1016/j.comp....
16.
Nooralishahi P, Ibarra-Castanedo C, Deane S et al. Drone-Based Non-Destructive Inspection of Industrial Sites: A Review and Case Studies. Drones 2021; 5(4): 106, https://doi.org/10.3390/drones....
17.
Nooralishahi P, Rezayiye R K, López F, Maldague X P V. PHM-IRNET: Self-training thermal segmentation approach for thermographic inspection of industrial components. NDT & E International 2023; 138: 102884, https://doi.org/10.1016/j.ndte....
18.
Ospina R, Itakura K. Obstacle detection and avoidance system based on layered costmaps for robot tractors. Smart Agricultural Technology 2025: 100973, https://doi.org/10.1016/j.atec....
19.
Ozdemir K, Tuncer A. Navigation of autonomous mobile robots in dynamic unknown environments based on dueling double deep q networks. Engineering Applications of Artificial Intelligence 2025; 139: 109498, https://doi.org/10.1016/j.enga....
20.
Pfändler P, Bodie K, Crotta G et al. Non-destructive corrosion inspection of reinforced concrete structures using an autonomous flying robot. Automation in Construction 2024; 158: 105241, https://doi.org/10.1016/j.autc....
21.
Pi R, Cieślak P, Esteba J et al. Compliant Manipulation With Quasi-Rigid Docking for Underwater Structure Inspection. IEEE Access 2023; 11: 128957–128969, https://doi.org/10.1109/ACCESS....
22.
Sabry A H, Ungku Amirulddin U A B. A review on fault detection and diagnosis of industrial robots and multi-axis machines. Results in Engineering 2024; 23: 102397, https://doi.org/10.1016/j.rine....
23.
Segal A, Haehnel D, Thrun S. Generalized-ICP. Robotics: Science and Systems V, Robotics: Science and Systems Foundation: 2009. doi:10.15607/RSS.2009.V.021, https://doi.org/10.15607/RSS.2....
24.
Szczepanski R, Tarczewski T, Erwinski K. Energy Efficient Local Path Planning Algorithm Based on Predictive Artificial Potential Field. IEEE Access 2022; 10: 39729–39742, https://doi.org/10.1109/ACCESS....
25.
Toman R, Rogala T, Synaszko P, Katunin A. Robotized Mobile Platform for Non-Destructive Inspection of Aircraft Structures. Applied Sciences 2024; 14(22): 10148, https://doi.org/10.3390/app142....
26.
Tsenis T, Tromaras A, Kappatos V. NDE Using Quadruped Robotic Platform for Renewable Energy Producing Infrastructures. 2024 IEEE 8th Energy Conference (ENERGYCON), Doha, Qatar, IEEE: 2024: 1–6, https://doi.org/10.1109/ENERGY....
27.
Wang B, Zhang L, Kim J. Fault Detection and Diagnosis of Three-Wheeled Omnidirectional Mobile Robot Based on Power Consumption Modeling. Mathematics 2024; 12(11): 1731, https://doi.org/10.3390/math12....
28.
Zhang J, Yuan X, Wang C et al. RF-Fusion: Robust and fine-grained volumetric panoptic mapping system with multi-level data fusion for robots. Information Fusion 2025; 122: 103209, https://doi.org/10.1016/j.inff....
29.
Zhao J, Xiao Z, Bai B et al. Defect Recognition of Transmission Line Unmanned Aerial Vehicle Inspection Images Based on Cascade R-CNN Algorithm. Eksploatacja i Niezawodność – Maintenance and Reliability 2025. doi:10.17531/ein/207303, https://doi.org/10.17531/ein/2....
| eISSN: | 2956-3860 |
| ISSN: | 1507-2711 |
We process personal data collected when visiting the website. The function of obtaining information about users and their behavior is carried out by voluntarily entered information in forms and saving cookies in end devices. Data, including cookies, are used to provide services, improve the user experience and to analyze the traffic in accordance with the Privacy policy. Data are also collected and processed by Google Analytics tool (more).
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
