Automated Sagittal Craniosynostosis Classification from CT Images Using Transfer Learning

Lei You1, Guangming Zhang1, Weiling Zhao1, Matthew Greives R2,3, Lisa David4 and Xiaobo Zhou1,5,6*

1School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Texas, USA
2McGovern Medical School at The University of Texas Health Science Center at Houston, USA
3Children’s Memorial Hermann Hospital, USA
4Department of Plastic and Reconstructive Surgery, Wake Forest Medical School of Medicine, Medical Center Boulevard, USA
5School of Dentistry, The University of Texas Health Science Center at Houston, Texas, USA
6Department of Integrative Biology and Pharmacology, McGovern Medical School, The University of Texas Health Science Center at Houston, Texas, USA

^*Correspondance to: Xiaobo Zhou 

 PDF  Full Text DOI: 10.25107/2474-1647.2746

Abstract

Purpose: Sagittal Craniosynostosis (CSO) occurs when the sagittal suture of a growing child’s skull is fused. Surgery is the primary treatment for CSO. Surgical treatment involves removing the affected bones and increasing the volume of the cranium by repositioning the bone segments or using external forces to guide growth. These external forces are often achieved by internal springs or external helmet therapy and depend on surgical judgment based on patient age, severity, and subtypes of CSO. Physicians usually classify CSO subtypes by examining CT images. In our previous work, we built an objective computerized system to mimic the physician’s diagnostic process based on more than 100 hand-crafted features. However, hand-crafted features-based methods have limitations in representing all aspect features of the CSO images. To improve feature extraction efficiency, classification accuracy, and reduce subjectivity in the choice of surgical techniques, in this study, we developed a deep learning-based method to learn advanced features for the classification of CSO subtypes. Methods: First, a Hounsfield Unit (HU) threshold-based method was used to segment 3D skulls from CT slices. Second, the 3D skulls were mapped to a two-dimension space by hemispherical projection to obtain binary images with a resolution of 512 × 512. These binary images were augmented to generate a new dataset for training deep convolutional neural networks. Finally, the pre-trained deep learning model was fine-tuned on the generated dataset using transfer learning method. Both training accuracy and cross-entropy curves were used to assess the performance of the proposed method. Results: Three deep convolutional neural networks were built based on the manual classification results of CSO patients by three surgeons. The classification difference between surgeons was 54%. The prediction accuracy of the three deep learning models based on the generated dataset was greater than 90%, which was higher than the accuracy from the previous models (72%). The model based on the classification results of the senior surgeon achieved the highest performance accuracy (75%) in unseen real data, compared to 25% and 37.5% for two junior surgeons, respectively. Conclusion: Our experimental results show that deep learning is superior to the hand-crafted feature-based method for sagittal CSO classification. The performance of deep learning models still depends on the quality of the original data. The classification variability of physicians can result in differential model outputs. When given more sagittal CSO images with proper annotations, the deep learning-based models can be more stable, approximate the diagnosis performance of physicians and have the potential to reduce the inter-observer variability thereby providing clinical insight into research and the treatment selection in patients with CSO.

Keywords

Sagittal craniosynostosis; Transfer learning; Convolutional neural networks; Medical image analysis

Cite the article

You L, Zhang G, Zhao W, Matthew Greives R, David L, Zhou X. Automated Sagittal Craniosynostosis Classification from CT Images Using Transfer Learning. Clin Surg. 2020; 5: 2746.