Brain Tumor Detection and Classification from MRI Images with Systematic Screening of a CNN–Transformer Hybrid Framework
DOI:
https://doi.org/10.47981/j.mijst.14(01)2026.591(71-83)Keywords:
Brain Tumor MRI Classification, Hybrid CNN–Transformer, Magnetic Resonance Imaging (MRI), Transfer Learning, Cross-ValidationAbstract
Brain tumors are the most fatal diseases of the central nervous system. Accurate, early MRI classification can support timely clinical decisions and treatment planning. This study systematically identifies an effective and efficient hybrid architecture combining Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) for multi-class brain tumor classification from 2D MRI images through a systematic screening evaluation. In this study, 12 CNN–Transformer pairs were evaluated under an identical training procedure using the original Kaggle train/test split. A late-concatenation fusion of DenseNet-121 and Swin-Tiny yielded the highest Kaggle testing accuracy of 94.38% during the screening stage. To provide a more reliable and fair comparison, a 10-fold stratified Cross-Validation (CV) was conducted on the Kaggle Training set only. The best-ranked pair was EfficientNet-B0 + Swin-Tiny, achieving a mean CV accuracy of 98.29% ± 0.55% with selective fine-tuning. The final model was trained on the Kaggle Training set, evaluated on the Kaggle Testing set, and tested on an independent external dataset (TEST2). The final model achieved 93.94% accuracy on the Kaggle Test Set and 87.21% accuracy on TEST2. The result indicates a notable domain shift under external validation. In addition, paired statistical significance tests among top model pairs, ablation studies on the fusion strategy and trainable ratio, and computational cost analysis (training time, inference latency, GPU memory, and parameter counts) are reported.
Downloads
References
Al Bataineh, A. F., Nahar, K. M. O., Khafajeh, H., Samara, G., Alazaidah, R., Nasayreh, A., Bashkami, A., Gharaibeh, H., & Dawaghreh, W. (2024). Enhanced magnetic resonance imaging-based brain tumor classification with a hybrid Swin Transformer and ResNet50V2 model. Applied Sciences, 14(22), 10154. https://doi.org/10.3390/app142210154
Amin, B. M., Elhalawany, M., Sultan, N., & Alwazzan, M. (2023). Brain tumor classification and segmentation using EfficientNet-B1 and U-Net: An approach using a transfer-learning model with contrast enhancement for improved segmentation and classification. arXiv. https://doi.org/10.48550/arXiv.2304.10039
Benzorgat, N., Xia, K., & Benzorgat, M. N. E. (2024). Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integration. PeerJ Computer Science, 10, e2425. https://doi.org/10.7717/peerj-cs.2425
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009). ImageNet: A large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition (pp. 248–255). IEEE.
https://doi.org/10.1109/CVPR.2009.5206848
Fang, Y., Sun, S., Wang, K., Peng, H., Chen, D., et al. (2023). EVA: Exploring the limits of masked visual representation at scale. arXiv.
https://doi.org/10.48550/arXiv.2303.11331
Goceri, E. (2025). An efficient network with CNN and transformer blocks for glioma grading and brain tumor classification from MRIs. Expert Systems with Applications, 268, 126290.
https://doi.org/10.1016/j.eswa.2024.126290
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 770–778). IEEE.
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017). Densely connected convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2261–2269). IEEE.
Khan, M. A., & Park, H. (2024). A convolutional block base architecture for multiclass brain tumor detection using magnetic resonance imaging. Electronics, 13(2), 364.
https://doi.org/10.3390/electronics13020364
Krishnan, P. T., Krishnadoss, P., Khandelwal, M., Gupta, D., Nihaal, A., & Kumar, T. S. (2024). Enhancing brain tumor detection in MRI with a rotation invariant Vision Transformer (RViT). Frontiers in Neuroinformatics, 18, 1413446.
https://doi.org/10.3389/fninf.2024.1413446
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021). Swin Transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) (pp. 10012–10022).
https://doi.org/10.1109/ICCV48922.2021.00986
Liu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., & Xie, S. (2022). A ConvNet for the 2020s. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 11976–11986). IEEE.
Nickparvar, M. (2021). Brain tumor MRI dataset [Data set]. Kaggle. https://www.kaggle.com/datasets/masoudnickparvar/brain-tumor-mri-dataset
Pacal, I. (2024). A novel Swin transformer approach utilizing residual multi-layer perceptron for diagnosing brain tumors in MRI images. International Journal of Machine Learning and Cybernetics, 15, 3579–3597.
https://doi.org/10.1007/s13042-024-02074-z
Panigrahi, S., Adhikary, D. R. D., & Pattanayak, B. K. (2025). Hybrid transfer learning and self-attention framework for robust MRI-based brain tumor classification. Scientific Reports, 15, 21343.
https://doi.org/10.1038/s41598-025-09311-5
Sharma, V. K., & Ameta, G. K. (2025). Hybrid 3D CNN–transformer model for early brain tumor detection with multi-modal magnetic resonance imaging. Bulletin of Electrical Engineering and Informatics, 14(5), 3923–3934.
https://doi.org/10.11591/eei.v14i5.11082
Tan, M., & Le, Q. V. (2019). EfficientNet: Rethinking model scaling for convolutional neural networks. In Proceedings of the 36th International Conference on Machine Learning (pp. 6105–6114). PMLR. https://proceedings.mlr.press/v97/tan19a.html
Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., & Jégou, H. (2021). Training data-efficient image transformers & distillation through attention. In Proceedings of the 38th International Conference on Machine Learning (pp. 10347–10357). PMLR.
Wang, S., Wang, C., Shao, Y., Chen, B., & Xu, Y. (2025). Enhanced MRI brain tumor detection using deep learning and radiomics features: Implementation details using real datasets. Scientific Reports, 15, 21717. https://doi.org/10.1038/s41598-025-13115-y
Zahoor, M. M., & Khan, S. H. (2025). CE-RS-SBCIT: A novel channel enhanced hybrid CNN–Transformer with residual, spatial, and boundary-aware learning for brain tumor MRI analysis. arXiv.
Downloads
Published
Data Availability Statement
Datasets generated during the current study are available from the corresponding author upon reasonable request.
Issue
Section
License
Copyright (c) 2026 Mohammad Shahjahan Majib, Faysal Ahmed, T. M. Shahriar Sazzad, Md. Mamun Or Rashid, Md. Ashraful Haque
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
This journal provides immediate open access to its content on the principle that making research freely available to the public supports a greater global exchange of knowledge. Users are permitted to read, download, copy, distribute, print, search, or link to the full texts of the articles, provided that appropriate credit is given to the original authors.
