Fetal heart chamber segmentation on fetal echocardiography image using deep learning
DOI:
https://doi.org/10.35335/mandiri.v14i1.416Keywords:
Confusion Matrix, Deep Learning, Fetal Echocardiography, Image SegmentationAbstract
Advances in medical imaging and utilization have encouraged the development of more sophisticated image analysis technologies. In this context, image segmentation acts as a fundamental preprocessing step, but fetal echocardiography (FE) image segmentation still faces challenges in terms of accuracy and efficiency. The dataset for developing the FE image segmentation model was obtained from the examination results of patients at Muhammad Husein Hospital (RSMH) in Palembang who had normal conditions, atrial septal defect (ASD), ventricular septal defect (VSD), and atrioventricular septal defect (AVSD), totaling 650 FE images, which have been verified by experts. Compared to previous studies, this study focuses on creating a DL-based segmentation model for FE images using an open-source framework and the Python MIScnn library, which is specifically designed for medical imaging. This differs from previous DL frameworks that are more general, such as TensorFlow or PyTorch, which do not emphasize specialization for medical imaging. Furthermore, in an effort to improve model accuracy and efficiency, various configurations were tested, including variations in batch size and loss functions. the Model performance evaluation was conducted comprehensively using various important metrics in addition to pixel accuracy and IoU, such as F1 score, average accuracy, precision, recall, and False Positive Rate (FPR). This method is expected to provide a more in-depth picture of model performance compared to previous studies that may have only considered a few metrics. The best results were achieved using the U-Net architecture with a batch size of 32 and the binary cross-entropy loss function. This U-Net model demonstrated excellent overall performance, achieving a pixel accuracy of 0.996, an IoU of 0.995, a mean accuracy of 0.965, an FPR of 0.004, a precision of 0.929, a recall of 0.933, and an F1-score of 0.941. These findings highlight the significant potential of deep learning methods in improving the accuracy and efficiency of fetal echocardiography image analysis.
References
Annina Simon, M. S. D., & Venkatesan, S, D. R. R. B. (2016). Machine Learning and its Applications: An Overview. University of Glasgow, Department of Computing, January.
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017). SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), 2481–2495. https://doi.org/10.1109/TPAMI.2016.2644615
Bouma, B. J., & Mulder, B. J. M. (2017). Changing Landscape of Congenital Heart Disease. Circulation Research, 120(6), 908–922. https://doi.org/10.1161/CIRCRESAHA.116.309302
Chen, L. C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018). DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(4), 834–848. https://doi.org/10.1109/TPAMI.2017.2699184
Chen, S., Hu, G., & Sun, J. (2020). Medical Image Segmentation Based on 3D U-net. 2020 19th International Symposium on Distributed Computing and Applications for Business Engineering and Science (DCABES), 130–133. https://doi.org/10.1109/DCABES50732.2020.00042
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016). 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation. http://arxiv.org/abs/1606.06650
Dolk, H., Loane, M., & Garne, E. (2011). Congenital heart defects in Europe: Prevalence and perinatal mortality, 2000 to 2005. Circulation, 123(8), 841–849. https://doi.org/10.1161/CIRCULATIONAHA.110.958405
Hesamian, M. H., Jia, W., He, X., & Kennedy, P. (2019). Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges. Journal of Digital Imaging, 32(4), 582–596. https://doi.org/10.1007/s10278-019-00227-x
Hoffman, J. I. E., & Kaplan, S. (2002). The incidence of congenital heart disease. Journal of the American College of Cardiology, 39(12), 1890–1900. https://doi.org/10.1016/S0735-1097(02)01886-7
Hou, Y. (2024). Applications of Image Segmentation Techniques in Medical Images. EAI Endorsed Transactions on E-Learning, 10. https://doi.org/10.4108/eetel.4449
Jasim, S. H., Haleot, R. A., & Thajeel, S. A. (2022). Brain Stroke Segmentation Based on U-NET Algorithm. 2022 International Conference on Data Science and Intelligent Computing (ICDSIC), 208–211. https://doi.org/10.1109/ICDSIC56987.2022.10076085
Kumar, P., & Kumar, S. (2012). Analyzing the Medical Image by using Clustering Algorithms Through Segmentation Process (Z. Zeng & Y. Li, Eds.; pp. 83490T-83490T – 5). https://doi.org/10.1117/12.923776
Liang, B., Peng, F., Luo, D., Zeng, Q., Wen, H., Zheng, B., Zou, Z., An, L., Wen, H., Wen, X., Liao, Y., Yuan, Y., & Li, S. (2024). Automatic segmentation of 15 critical anatomical labels and measurements of cardiac axis and cardiothoracic ratio in fetal four chambers using nnU-NetV2. BMC Medical Informatics and Decision Making, 24(1). https://doi.org/10.1186/s12911-024-02527-x
Long, J., Shelhamer, E., & Darrell, T. (2015). Fully Convolutional Networks for Semantic Segmentation.
Manai, E., Mejri, M., & Fattahi, J. (2024). Confusion Matrix Explainability to Improve Model Performance: Application to Network Intrusion Detection. 2024 10th International Conference on Control, Decision and Information Technologies (CoDIT), 1–5. https://doi.org/10.1109/CoDIT62066.2024.10708595
Miller, O. I., Simpson, J., & Zidere, V. (2018). Abnormalities of the Four Chamber View. In Fetal Cardiology (pp. 71–99). Springer International Publishing. https://doi.org/10.1007/978-3-319-77461-9_7
Ming Liang, & Xiaolin Hu. (2015). Recurrent convolutional neural network for object recognition. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 3367–3375. https://doi.org/10.1109/CVPR.2015.7298958
Navab, N., Hornegger, J., Wells, W. M., & Frangi, A. F. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9351(Cvd), 12–20. https://doi.org/10.1007/978-3-319-24574-4
Nurmaini, S., Rachmatullah, M. N., Sapitri, A. I., Darmawahyuni, A., Tutuko, B., Firdaus, F., Partan, R. U., & Bernolian, N. (2021). Deep learning‐based computer‐aided fetal echocardiography: Application to heart standard view segmentation for congenital heart defects detection. Sensors, 21(23). https://doi.org/10.3390/s21238007
Patri, H. V., Priya, M. B., Mothukuri, M. B., Kumar, D. M., Ratna Prabha, K. V., & Gandham, S. R. K. (2024). U-Net Advancements in Semantic Segmentation for Autonomous Vehicles. 2024 10th International Conference on Advanced Computing and Communication Systems (ICACCS), 2292–2296. https://doi.org/10.1109/ICACCS60874.2024.10717217
Rawat, V., Jain, A., & Shrimali, V. (2018). Automated techniques for the interpretation of fetal abnormalities: A review. Applied Bionics and Biomechanics, 2018. https://doi.org/10.1155/2018/6452050
Siddique, N., Paheding, S., Elkin, C. P., & Devabhaktuni, V. (2021). U-Net and Its Variants for Medical Image Segmentation: A Review of Theory and Applications. IEEE Access, 9, 82031–82057. https://doi.org/10.1109/ACCESS.2021.3086020
Siddique, N., Sidike, P., Elkin, C., & Devabhaktuni, V. (2020). U-Net and its variants for medical image segmentation: theory and applications. http://arxiv.org/abs/2011.01118
Sun, H. Y. (2021). Prenatal diagnosis of congenital heart defects: echocardiography. Translational Pediatrics, 10(8), 2210–2224. https://doi.org/10.21037/tp-20-164
Toscano, R. (2024). Machine Learning (pp. 203–238). https://doi.org/10.1007/978-3-031-52459-2_7
Wu, Z., Liu, W., & Chang, J. (2024). Improving U-Net Performance for Tumor Segmentation Using Attention Mechanisms. Journal of Computer Science Research, 6(4), 66–72. https://doi.org/10.30564/jcsr.v6i4.7271
Xu, L., Liu, M., Shen, Z., Wang, H., Liu, X., Wang, X., Wang, S., Li, T., Yu, S., Hou, M., Guo, J., Zhang, J., & He, Y. (2020). DW-Net: A cascaded convolutional neural network for apical four-chamber view segmentation in fetal echocardiography. Computerized Medical Imaging and Graphics, 80. https://doi.org/10.1016/j.compmedimag.2019.101690
Yin, X.-X., Sun, L., Fu, Y., Lu, R., & Zhang, Y. (2022). U-Net-Based Medical Image Segmentation. Journal of Healthcare Engineering, 2022, 1–16. https://doi.org/10.1155/2022/4189781
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017). Pyramid Scene Parsing Network. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 6230–6239. https://doi.org/10.1109/CVPR.2017.660
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Sutarno Sutarno, Muhammad Naufal Rachmatullah, Abdurahman, Rahmat Fadli Isnanto
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
