ACDW-InceptionNeXt: adjacent class distinguished and class distance weighted InceptionNeXt-based computer-aided mayo endoscopic scoring system for still images and video segments

Khanna R, Ma C, Jairath V, Vande Casteele N, Zou G, Feagan BG. Endoscopic assessment of inflammatory bowel disease activity in clinical trials. Clin Gastroenterol Hepatol. 2022;20(4):727-36 e2. https://doi.org/10.1016/j.cgh.2020.12.017.

Article  Google Scholar 

Chen D, Fulmer C, Gordon IO, Syed S, Stidham RW, Vande Casteele N, et al. Application of artificial intelligence to clinical practice in inflammatory bowel disease—what the clinician needs to know. J Crohns Colitis. 2022;16(3):460–71. https://doi.org/10.1093/ecco-jcc/jjab169.

Article  Google Scholar 

Alammari A, Islam AR, Oh J, Tavanapong W, Wong J, Groen PCD. Classification of ulcerative colitis severity in colonoscopy videos using CNN. In: Proceedings of the 9th international conference on information management and engineering. Barcelona: Association for Computing Machinery; 2017. p. 139–44.

Dahal A, Oh J, Tavanapong W, Wong J, Groen PCD. Detection of ulcerative colitis severity in colonoscopy video frames. In: 2015 13th International workshop on content-based multimedia indexing (CBMI). 2015. p. 1–6.

Stidham RW, Liu W, Bishu S, Rice MD, Higgins PDR, Zhu J, et al. Performance of a deep learning model vs human reviewers in grading endoscopic disease severity of patients with ulcerative colitis. JAMA Netw Open. 2019;2(5):e193963. https://doi.org/10.1001/jamanetworkopen.2019.3963.

Article  Google Scholar 

Sutton RT, Zai Ane OR, Goebel R, Baumgart DC. Artificial intelligence enabled automated diagnosis and grading of ulcerative colitis endoscopy images. Sci Rep. 2022;12(1):2748. https://doi.org/10.1038/s41598-022-06726-2.

Article  Google Scholar 

Yao H, Najarian K, Gryak J, Bishu S, Rice MD, Waljee AK, et al. Fully automated endoscopic disease activity assessment in ulcerative colitis. Gastrointest Endosc. 2021;93(3):728–36 e1. https://doi.org/10.1016/j.gie.2020.08.011

Gottlieb K, Requa J, Karnes W, Gudivada RC, Shen J, Rael E, et al. Central reading of ulcerative colitis clinical trial videos using neural networks. Gastroenterology. 2021;160(3):710–9 e2. https://doi.org/10.1053/j.gastro.2020.10.024

de Jong DC, Lowenberg M, Koumoutsos I, Ray S, Mawdsley J, Anderson S, et al. Validation and investigation of the operating characteristics of the ulcerative colitis endoscopic index of severity. Inflamm Bowel Dis. 2019;25(5):937–44. https://doi.org/10.1093/ibd/izy325.

Article  Google Scholar 

Shi X, Cao W, Raschka SJPA, Applications. Deep neural networks for rank-consistent ordinal regression based on conditional probabilities. arXiv2023. p. 941–55.

Polat G, Kani HT, Ergenc I, Ozen Alahdab Y, Temizel A, Atug O. Improving the computer-aided estimation of ulcerative colitis severity according to Mayo endoscopic score by using regression-based deep learning. Inflamm Bowel Dis. 2023;29(9):1431–9. https://doi.org/10.1093/ibd/izac226.

Article  Google Scholar 

Polat G, Ergenc I, Kani HT, Alahdab YO, Atug O, Temizel A. Class distance weighted cross-entropy loss for ulcerative colitis severity estimation. In: Annual conference on medical image understanding and analysis. Berlin: Springer; 2022. p. 157–71.

Wang J, Cheng Y, Chen J, Chen T, Chen D, Wu J. Ord2Seq: regarding ordinal regression as label sequence prediction. In: 2023 IEEE/CVF international conference on computer vision (ICCV). 2023. p. 5842–52.

Chang D, Ding Y, Xie J, Bhunia AK, Li X, Ma Z, et al. The devil is in the channels: mutual-channel loss for fine-grained image classification. IEEE Trans Image Process. 2020. https://doi.org/10.1109/TIP.2020.2973812.

Article  Google Scholar 

Woo S, Debnath S, Hu R, Chen X, Liu Z, Kweon IS, et al. ConvNeXt V2: co-designing and scaling ConvNets with masked autoencoders. In: 2023 IEEE/CVF conference on computer vision and pattern recognition (CVPR). 2023. p. 16133–42.

Liu Z, Mao H, Wu CY, Feichtenhofer C, Darrell T, Xie S. A ConvNet for the 2020s. In: 2022 IEEE/CVF conference on computer vision and pattern recognition (CVPR). 2022. p. 11966–76.

Touvron H, Cord M, Douze M, Massa F, Sablayrolles A, Jégou H. Training data-efficient image transformers & distillation through attention. In: International conference on machine learning. PMLR. 2021. p. 10347–57.

Liu Z, Lin Y, Cao Y, Hu H, Wei Y, Zhang Z, et al. Swin transformer: Hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF international conference on computer vision. 2021. p. 10012–22.

Yu W, Zhou P, Yan S, Wang X. InceptionNeXt: when inception meets ConvNeXt. In: 2024 IEEE/CVF conference on computer vision and pattern recognition (CVPR). 2024. p. 5672–83.

Polat G, Kani HT, Ergenc I, Alahdab YO, Temizel A, Atug O. Labeled images for ulcerative colitis (LIMUC) dataset. Zenodo 2022.

Schroeder KW, Tremaine WJ, Ilstrup DM. Coated oral 5-aminosalicylic acid therapy for mildly to moderately active ulcerative colitis. A randomized study. N Engl J Med. 1987;317(26):1625–9. https://doi.org/10.1056/NEJM198712243172603.

Article  Google Scholar 

He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. p. 770–8.

Goodfellow I, Warde-Farley D, Mirza M, Courville A, Bengio Y. Maxout networks. In: International conference on machine learning. PMLR 2013. p. 1319–27.

Graham P, Jackson R. The analysis of ordinal agreement data: beyond weighted kappa. J Clin Epidemiol. 1993;46(9):1055–62. https://doi.org/10.1016/0895-4356(93)90173-x.

Article  Google Scholar 

Fawcett T. An introduction to ROC analysis. Pattern Recognit Lett. 2006;27(8):861–74. https://doi.org/10.1016/j.patrec.2005.10.010.

Article  MathSciNet  Google Scholar 

Pyatha A, Xu Z, Ali S, et al. Vision transformer-based self-supervised learning for ulcerative colitis grading in colonoscopy. In: Bhattarai B, Ali S, Rau A, Nguyen A, Namburete A, Caramalau R, et al., editors. Data engineering in medical imaging. Cham: Springer; 2023. p. 102–10.

Chapter  Google Scholar 

Dermyer P, Kalra A, Schwartz M. EndoDINO: a foundation model for GI endoscopy. 2025. https://arxiv.org/abs/2501.05488

Turan M, Durmus F. UC-NfNet: deep learning-enabled assessment of ulcerative colitis from colonoscopy images. Med Image Anal. 2022;82:102587. https://doi.org/10.1016/j.media.2022.102587.

Article  Google Scholar 

Wu S, Zhang R, Yan J, Li C, Liu Q, Wang L, et al. High-speed and accurate diagnosis of gastrointestinal disease: learning on endoscopy images using lightweight transformer with local feature attention. Bioengineering (Basel). 2023. https://doi.org/10.3390/bioengineering10121416.

Article  Google Scholar 

Gonzalez-Bueno Puyal J, Brandao P, Ahmad OF, Bhatia KK, Toth D, Kader R, et al. Spatio-temporal classification for polyp diagnosis. Biomed Opt Express. 2023;14(2):593–607. https://doi.org/10.1364/boe.473446.

Article  Google Scholar 

Comments (0)

No login
gif