Escobar, C. A., M. E. McGovern, and R. Morales-Menendez. 2021. “Quality 4.0: A review of big data challenges in manufacturing.” Journal of Intelli- gent Manufacturing 32 (8): 2319–34. https://doi.org/10.1007/s10845-021- 01765-4. Fiorito, A. M., A. Østvik, E. Smistad, S. Leclerc, O. Bernard, and L. Lovstakken. 2018. “Detection of cardiac events in echocardiography using 3D convolutional recurrent neural networks.” 2018 IEEE International Ultrasonics Symposium (IUS). Kobe, Japan: 1–4. https://doi.org/10.1109/ ULTSYM.2018.8580137. Psarommatis, F., F. Fraile, J. P. Mendonca, O. Meyer, O. Lazaro, and D. Kiritsis. 2023. “Zero defect manufacturing in the era of industry 4.0 for achieving sustainable and resilient manufacturing.” Frontiers in Manufacturing Technology 3. https://doi.org/10.3389/fmtec.2023.1124624. Psarommatis, F., J. Sousa, J. P. Mendonça, and D. Kiritsis. 2022. “Zero- defect manufacturing the approach for higher manufacturing sustain- ability in the era of industry 4.0: A position paper.” International Journal of Production Research 60 (1): 73–91. https://doi.org/10.1080/00207543.2021. 1987551. Guo, Y., Z. Xiao, L. Geng, J. Wu, F. Zhang, Y. Liu, and W. Wang. 2019. “Fully convolutional neural network with GRU for 3D braided composite material flaw Detection.” IEEE Access: Practical Innovations, Open Solutions 7:151180–88. https://doi.org/10.1109/ACCESS.2019.2946447. Guo, Y., Z. Xiao, and L. Geng. 2023. “Defect detection of 3D braided composites based on semantic segmentation.” Journal of the Textile Insti- tute. https://doi.org/10.1080/00405000.2022.2054103. He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep residual learning for image recognition.” 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV: 770–778. https://doi.org/10.1109/ CVPR.2016.90. Hu, J., E. Smistad, I. M. Salte, H. Dalen, and L. Lovstakken. 2022. “Exploiting temporal information in echocardiography for improved image segmentation.” 2022 IEEE International Ultrasonics Symposium (IUS). Venice, Italy: 1–4. https://doi.org/10.1109/IUS54386.2022.9958670. Huang, L., X. Hong, Z. Yang, Y. Liu, and B. Zhang. 2022. “CNN-LSTM network-based damage detection approach for copper pipeline using laser ultrasonic scanning.” Ultrasonics 121:106685. https://doi.org/10.1016/j. ultras.2022.106685. Ioffe, S. and C. Szegedy. 2015. “Batch normalization: accelerating deep network training by reducing internal covariate shift.” arXiv:1502.03167 [cs. LG]. https://doi.org/10.48550/ARXIV.1502.03167. Kingma, D. P. and J. Ba. 2015. “Adam: A method for stochastic optimi- zation.” 3rd International Conference for Learning Representations, San Diego, CA. Liu, Z., Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin, and B. Guo. 2021. “Swin transformer: hierarchical vision transformer using shifted windows.” 2021 IEEE/CVF International Conference on Computer Vision (ICCV). Montreal, QC, Canada: 9992–10002. https://doi.org/10.1109/ ICCV48922.2021.00986. Maev, R., F. Ewasyshyn, S. Titov, J. Paille, E. Maeva, A. Denisov, and F. Seviaryn. 2005. Method and apparatus for assessing the quality of spot welds. US Patent 7,775,415 B2, filed 14 June 2005, and issued 17 August 2010. Maev, R. Gr., A. M. Chertov, J. M. Paille, and F. J. Ewasyshyn. 2013. Ultra- sonic in-process monitoring and feedback of resistance spot weld quality. US Patent 9,296,062 B2, filed 10 June 2013, and issued 29 March 2016. Maev, R. Gr., A. M. Chertov, W. Perez-Regalado, A. Karloff, A. Tchipilko, P. Lichaa, D. Clement, and T. Phan. 2014. “In-line inspection of resistance spot welds for sheet metal assembly.” Welding Journal 93: 58-62. Maev, R. Gr., and A. M. Chertov. 2010. Electrode cap for ultrasonic testing, US Patent 8,381,591 B2, filed 18 March 2010, and issued 26 February 2013. Maev, R. Gr., A. Chertov, R. Scott, D. Stocco, A. Ouellette, A. Denisov, A., and Y, Oberdoerfer. 2021. “NDE in the automotive sector.” in Handbook of Nondestructive Evaluation 4.0. Springer Nature Switzerland AG. Meyendorf, N., L. Bond, J. Curtis-Beard, S. Heilmann, S. Pal, R. Schallert, H. Scholz, and C. Wunderlich. 2017. “NDE 4.0—NDE for the 21st century— the internet of things and cyber physical systems will revolutionize NDE.” 15th Asia Pacific Conference for Non-Destructive Testing (APCNDT 2017), Singapore. Neugebauer, R., T. Wiener, and A. Zösch. 2013. “Quality control of resis- tance spot welding of high strength steels.” Procedia CIRP 12:139–44. https://doi.org/10.1016/j.procir.2013.09.025. Ouellette, A., A. C. Karloff, W. Perez-Regalado, A. M. Chertov, R. G. Maev, and P. Lichaa. 2013. “Real-time ultrasonic quality control monitoring in resistance spot welding: Today and tomorrow.” Materials Evaluation 71 (7). Perez-Regalado, W., A. Ouellette, A. M. Chertov, V. Leshchynsky, and R. G. Maev. 2013. “Joining dissimilar metals: A novel two-step process with ultrasonic monitoring.” Materials Evaluation 71 (7): 828–33. Reis, F.F., V. Furlanetto, and G. F. Batalha. 2016. “Resistance spot weld in vehicle structures using dynamic resistance adaptive control.” SAE Tech- nical Paper, 2016-36-0303. https://doi.org/10.4271/2016-36-0303. Ronneberger, O., P. Fischer, and T. Brox. 2015. “U-Net: Convolutional networks for biomedical image segmentation.” Medical Image Computing and Computer-Assisted Intervention (MICCAI): 234–241. https://doi. org/10.1007/978-3-319-24574-4_28. Runnemalm, A., and A. Appelgren. 2012. “Evaluation of non-destructive testing methods for automatic quality checking of spot welds.” Report. Retrieved from http://urn.kb.se/resolve?urn=urn:nbn:se:hv:diva-5578. Shandiz, A. H., and L. Tóth. 2022. “Improved processing of ultrasound tongue videos by combining convLSTM and 3D convolutional networks.” Advances and Trends in Artificial Intelligence. Theory and Practices in Arti- ficial Intelligence: 265–274. https://doi.org/10.1007/978-3-031-08530-7_22. Shi, X., Z. Chen, H. Wang, D.-Y. Yeung, W.-K. Wong, and W.-C. Woo. 2015. “Convolutional LSTM Network: a machine learning approach for precipi- tation nowcasting.” In Proceedings of the 28th International Conference on Neural Information Processing Systems: 802–810. Summerville, C., P. Compston, and M. Doolan. 2019. “A comparison of resistance spot weld quality assessment techniques.” Procedia Manufac- turing 29:305–12. https://doi.org/10.1016/j.promfg.2019.02.142. Sung Hoon, J., N. Yang Woo, Y. Sanghyun, K. Si Eun, R. Gr. Maev, A. M. Chertov, D. R. Scott, and D. Stocco. 2020. System and method for resis- tance spot welding control. Korea Patent 10-2166234-0000. Korean Intellec- tual Property Office. Filed 28 January 2020, and issued 25 August 2020. Taheri, H., M. Gonzalez Bocanegra, and M. Taheri. 2022. “Artificial intelli- gence, machine learning and smart technologies for nondestructive evalu- ation.” Sensors (Basel) 22 (11): 4055. https://doi.org/10.3390/s22114055. Virkkunen, I., T. Koskinen, O. Jessen-Juhler, and J. Rinta-aho. 2021. “Augmented ultrasonic data for machine learning.” Journal of Nondestruc- tive Evaluation 40 (1): 4. https://doi.org/10.1007/s10921-020-00739-5. Virtanen, V., R. Gommers, T. E. Oliphant, M. Haberland, T. Reddy, D. Cournapeau, E. Burovski, et al. 2020. “SciPy 1.0: Fundamental algorithms for scientific computing in python.” Nature Methods 17: 261–72. https://doi. org/10.1038/s41592-019-0686-2. Woo, S., J. Park, J-Y. Lee, and I.S. Kweon. 2018. “CBAM: Convolutional block attention module.” Proceedings of the European Conference on Computer Vision (ECCV): 3–19. https://doi.org/10.48550/arXiv.1807.06521. Zamiela, C., Z. Jiang, R. Stokes, Z. Tian, A. Netchaev, C. Dickerson, W. Tian, and L. Bian. 2023. “Deep multi-modal U-Net fusion methodology of thermal and ultrasonic images for porosity.” Journal of Manufacturing Science and Engineering 145 (6). https://doi.org/10.1115/1.4056873. ME |AI/ML 70 M A T E R I A L S E V A L U A T I O N J U L Y 2 0 2 3 2307 ME July dup.indd 70 6/19/23 3:41 PM
ABSTR ACT This paper presents a novel data-driven approach to localize two types of acoustic emission sources in an aluminum plate, namely a Hsu-Nielsen source, which simulates a crack-like source, and steel ball impacts of varying diameters acting as the impact source. While deep neural networks have shown promise in previous studies, achieving high accuracy requires a large amount of training data, which may not always be feasible. To address this challenge, we investigated the applicability of transfer learning to address the issue of limited training data. Our approach involves transferring knowledge learned from numerical modeling to the experimental domain to localize nine different source locations. In the process, we evaluated six deep learning architectures using tenfold cross- validation and demonstrated the potential of transfer learning for efficient acoustic emission source localization, even with limited experimental data. This study contributes to the growing demand for running deep learning models with limited capacity and training time and highlights the promise of transfer learning methods such as fine-tuning pretrained models on large semi-related datasets. KEYWORDS: acoustic emission, deep neural network, finite element modeling, transfer learning, fiber optics, source localization Introduction Acoustic emission source localization is crucial in struc- tural health monitoring (SHM) and proactive maintenance of metallic structures. The constraints in deploying acoustic emission testing (AE) sensor arrays in real-world structures necessitate a shift toward intelligent, automated single-sensor approaches. Holford et al. (2001) pioneered the application of AE for damage location in steel bridges, establishing its impor- tance in SHM. Ebrahimkhanlou and Salamone (2017) further examined acoustic source localization and its significance in determining the origin of acoustic emission waves and assess- ing damage severity. Cheng et al. (2021) developed an acoustic emission source localization method using Lamb wave propa- gation simulation and artificial neural networks, proving effec- tive in I-shaped steel girder inspections. Ai et al. (2021) studied source localization on large-scale canisters used for nuclear fuel storage, addressing the need for optimal AE sensor deploy- ment. Ciampa and Meo (2010) proposed an approach using wavelet analysis and a Newton-based optimization technique for acoustic emission source localization and velocity determi- nation, contributing to the broader understanding of acoustic emission wave propagation and source detection. Significant progress has been achieved in acoustic emission source localization through the application of deep learning, demonstrating its promise in localizing acoustic emission signals (LeCun et al. 2015). Ebrahimkhanlou and Salamone (2018) proposed a deep learning approach for localizing acoustic emission sources using a single sensor in plate-like structures. This was further advanced by Ebrahimkhanlou et al. (2019), who introduced a deep learning–based framework for localizing and characterizing acoustic emission sources in metallic panels using only one sensor. Garrett et al. (2022) utilized artificial intelligence for estimating fatigue crack length from acoustic emission waves, a significant step forward in damage localization and quantification. Despite the challenge of false positives, the fusion of artificial intelligence and AE holds promising opportunities for enhancing SHM (Verstrynge et al. 2021 Hassan et al. 2021). A key challenge in using supervised learning algorithms for acoustic emission source localization is the difficulty in accessing labeled acoustic emission signals for existing struc- tures. Transfer learning is a strategy that assists the super- vised learning task when available training data is limited ACOUSTIC EMISSION SOURCE LOCALIZATION USING DEEP TRANSFER LEARNING AND FINITE ELEMENT MODELING– BASED KNOWLEDGE TRANSFER XUHUI HUANG*, OBAID ELSHAFIEY*, KARIM FARZIA†, LALITA UDPA*, MING HAN*, AND YIMING DENG*‡ *Department of Electrical and Computer Engineering, Michigan State University, East Lansing, MI Nikon Inc., 9453 Innovation Dr., Manassas, VA Corresponding author: dengyimi@egr.msu.edu Materials Evaluation 81 (7): 71–84 https://doi.org/10.32548/2023.me-04348 ©2023 American Society for Nondestructive Testing NDTTECHPAPER |ME J U L Y 2 0 2 3 M A T E R I A L S E V A L U A T I O N 71 2307 ME July dup.indd 71 6/19/23 3:41 PM
Previous Page Next Page