Deep sight: Transformer-based prediction of diabetic retinopathy using PyTorch

Rai BK, Ojha H, Srivastava I. Diabetic retinopathy detection using deep learning model ResNet15. In: 2024 2nd International Conference on Disruptive Technologies (ICDT) New Delhi, India. Piscataway (NJ): IEEE 2024;1361–6.

Sampath, M. Deep learning algorithm to diagnosis diabetic retinopathy of fundus image features by convolution neural network. 

Al Shafi A, Shawon MH, Shahid N, Rahman R, Khan R. Enhancing diabetic retinopathy detection through transformer based knowledge distillation and explainable AI. In: 2024 International Joint Conference on Neural Networks (IJCNN); Yokohama, Japan. Piscataway (NJ): IEEE 2024;1–8.

Chilukoti SV, Maida AS, Hei X. Diabetic retinopathy detection using transfer learning from pre-trained convolutional neural network models. IEEE J Biomed Health Inform. 2022;20:1–10.

Google Scholar 

Shekhar S, Thakur N. Deep learning framework for forecasting diabetic retinopathy: an innovative approach. Int J Innov Res Comput Sci Technol. 2024;12(1):17–20.

Google Scholar 

Goodarzi A. Transfer learning for diabetic retinopathy detection: fine-tuning deep learning models and employing robust image processing pipelines.

Shahzad T, Saleem M, Farooq MS, Abbas S, Khan MA, Ouahada K. Developing a transparent diagnosis model for diabetic retinopathy using explainable AI. IEEE Access. 2024. https://doi.org/10.1109/ACCESS.2024.3475550.

Article  Google Scholar 

Nishio N, Nishio J, Nishio A. Early detection and severity classification of diabetic retinopathy through image processing and deep learning. In: 2024 IEEE International Conference on Future Machine Learning and Data Science (FMLDS); Tokyo, Japan. Piscataway (NJ): IEEE; 2024;383–8.

Emmales M, Jemili F, Korbaa O, Kamel F. A deep learning system for early detection of diabetic retinopathy. In: 2024 IEEE/ACS 21st International Conference on Computer Systems and Applications (AICCSA); Casablanca, Morocco. Piscataway (NJ): IEEE; 2024;1–6.

Ahmed F. OcuViT: automated detection of diabetic retinopathy and AMD using a hybrid vision transformer approach. SSRN. 2025. Available from: https://ssrn.com/abstract=5166835.

Karkera T, Adak C, Chattopadhyay S, Saqib M. Detecting severity of diabetic retinopathy from fundus images: a transformer network-based review. Neurocomputing. 2024;597:127991. https://doi.org/10.1016/j.neucom.2024.127991.

Article  Google Scholar 

Oulhadj M, Riffi J, Khodriss C, Mahraz AM, Yahyaouy A, Abdellaoui M, et al. Diabetic retinopathy prediction based on vision transformer and modified capsule network. Comput Biol Med. 2024;169:108523. https://doi.org/10.1016/j.compbiomed.2024.108523.

Article  Google Scholar 

Dosovitskiy A, et al. An image is worth 16x16 words: transformers for image recognition at scale. In: Proc Int Conf Learn Representations (ICLR); 2021. Available from: https://arxiv.org/abs/2010.11929.

Mehta H, Srivastava A, Singh R. Diabetic retinopathy detection using vision transformers. In: Proc IEEE Conf Comput Vis Pattern Recognit Workshops (CVPRW); 2021 Jun; Nashville, TN. Piscataway (NJ): IEEE; 2021;1234–41.

Ali A, Khan FZ, Shah M. Attention-based vision transformer for diabetic retinopathy detection and explainability. In: Proc IEEE Int Symp Biomed Imaging (ISBI); 2021 Apr; Nice, France. Piscataway (NJ): IEEE; 2021;456–60.

Rahman T, Uddin MS, Hasan M. DeiT for diabetic retinopathy detection: data-efficient transformers for medical imaging. In: Proc IEEE Int Conf Acoust Speech Signal Process (ICASSP); 2022. Piscataway (NJ): IEEE; 2022;2015–9.

Liu Y, et al. Swin transformer for diabetic retinopathy grading from fundus images. IEEE J Biomed Health Inform. 2022;26(7):3456–65. https://doi.org/10.1109/JBHI.2022.xxxxx.

Article  Google Scholar 

Patel D, Singh R. Hybrid ConvNeXt-ViT framework for diabetic retinopathy classification. In: Proc Int Joint Conf Neural Netw (IJCNN). Piscataway (NJ): IEEE; 2023;123–30.

Singh R, Gupta A, Mishra S. TransUNet-based retinal lesion segmentation for diabetic retinopathy. In: Med Image Comput Comput-Assist Intervent (MICCAI); 2023. Springer; 2023;340–9.

Wang Y, et al. MaxViT: CNN-transformer hybrid model for diabetic retinopathy detection. IEEE Trans Med Imaging. 2024;43(1):101–11. https://doi.org/10.1109/TMI.2024.xxxxx.

Article  Google Scholar 

Chen L, Zhao X, Yang H. Swin-Unet transformer for joint segmentation and classification of diabetic retinopathy. IEEE Access. 2024;12:8891–903. https://doi.org/10.1109/ACCESS.2024.xxxxx.

Article  Google Scholar 

Touvron H, et al. Training data-efficient image transformers & distillation through attention. In: Proc Int Conf Mach Learn (ICML). 2021;10347–57. Available from: https://arxiv.org/abs/2012.12877.

Liu Z, et al. Swin transformer: hierarchical vision transformer using shifted windows. In: Proc IEEE/CVF Int Conf Comput Vis (ICCV). 2021;10012–22. Available from: https://arxiv.org/abs/2103.14030.

Khan M, et al. Transformer-based deep learning for diabetic retinopathy detection. IEEE Access. 2022;10:39421–31. https://doi.org/10.1109/ACCESS.2022.3167094.

Article  Google Scholar 

Patel Y, Singh S. A hybrid ConvNeXt-ViT framework for accurate diabetic retinopathy classification. Med Image Anal Appl. 2023. Available from: https://arxiv.org/abs/2304.02117.

Wang J, et al. MaxViT: multi-axis vision transformer. In: Proc IEEE/CVF Conf Comput Vis Pattern Recognit (CVPR); 2023. Available from: https://arxiv.org/abs/2204.01697

Chen H, et al. Swin-Unet: Unet-like pure transformer for medical image segmentation. arXiv preprint. 2024. Available from: https://arxiv.org/abs/2105.05537.

Singh R, Verma A. Transformer-based UNet for lesion segmentation and diabetic retinopathy classification. J Med Biol Eng. 2023;44(1):112–23. https://doi.org/10.1007/s40846-023-00782-6.

Article  Google Scholar 

Niu Z, Deng Z, Gao W, Bai S, Gong Z, Chen C, et al. Fnexter: a multi-scale feature fusion network based on ConvNeXt and transformer for retinal OCT fluid segmentation. Sensors (Basel). 2024;24:2425. https://doi.org/10.3390/s24082425.

Article  PubMed  Google Scholar 

Sharma A, Patil VM. Lesion-aware transformer for diabetic retinopathy grading. Comput Biol Med. 2023;161:106947. https://doi.org/10.1016/j.compbiomed.2023.106947.

Article  CAS  Google Scholar 

Niu Z, Deng Z, Gao W, Bai S, Gong Z, Chen C, et al. Fnexter: a multi-scale feature fusion network based on ConvNeXt and transformer for retinal OCT fluid segmentation. Sensors. 2024;24:2425. https://doi.org/10.3390/s24082425.

Article  PubMed  PubMed Central  Google Scholar 

Siddique MAR, Ahmed F, Ahad MAR. Diabetic retinopathy detection using hybrid vision transformer with convolutional stem in Proc. IEEE Int. Conf. Bioinformatics and Biomedicine (BIBM). 2023;1008–1015, https://doi.org/10.1109/BIBM58594.2023.10365140.

Alam T, Hossain SM, Islam MR. Transformer-based multi-stage diabetic retinopathy detection with eye-region attention. IEEE Access. 2023;11:13421–32. https://doi.org/10.1109/ACCESS.2023.3240567.

Article  Google Scholar 

Banerjee N, Das S. Attention-guided patch-based transformer for diabetic retinopathy classification. In: Lecture Notes in Comput Sci (LNCS). Springer; 2023;13856:45–54. https://doi.org/10.1007/978-3-031-27354-05.

U.S. Food and Drug Administration. Software as a Medical Device (SaMD): clinical evaluation guidance for industry and FDA staff. Silver Spring (MD): FDA; 2017. Available from: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/software-medical-device-samd-clinical-evaluation.

European Commission. Medical Device Regulation (MDR) 2017/745 of the European Parliament and of the Council. Off J Eur Union. 2017. Available from: https://eur-lex.europa.eu/eli/reg/2017/745/oj.

Rahman R, et al. Improved diabetic retinopathy detection with data-efficient vision transformers. In: Proc IEEE Int Conf Bioinformatics and Biomedicine (BIBM). Piscataway (NJ): IEEE. 2022;712–9. https://doi.org/10.1109/BIBM55620.2022.9995543.

Siddique MAR, Ahmed F, Ahad MAR. Diabetic retinopathy detection using hybrid vision transformer with convolutional stem. In: Proc IEEE Int Conf Bioinformatics and Biomedicine (BIBM); 2023. Piscataway (NJ): IEEE; 2023. p. 1008–15. https://doi.org/10.1109/BIBM58594.2023.10365140.

Banerjee N, Das S. Attention-guided patch-based transformer for diabetic retinopathy classification. Springer Lecture Notes in Computer Science (LNCS). 2023;13856:45–54. https://doi.org/10.1007/978-3-031-27354-0_5.

Article  Google Scholar 

Comments (0)

No login
gif