Skip to main content

GCNet: Global Context-Guided Uncertainty Boundary for Polyp Segmentation

  • Conference paper
  • First Online:
Pattern Recognition and Computer Vision (PRCV 2024)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 15045))

Included in the following conference series:

Abstract

Colorectal cancer, with the third highest incidence and mortality rates, underscores the importance of accurately segmenting polyps in colonoscopy images. Despite advancements in deep learning-based methods, several challenges persist: (1) The uneven surface of the colon wall introduces significant background noise in images; (2) The varied sizes of colonic polyps make detection difficult; (3) The potential of cross-layer features is not fully harnessed. Addressing these issues, we propose the Global context-guided uncertainty boundary for polyp segmentation (GCNet). Our method leverages cross-layer features for both boundary and global context extraction, enhancing its expressive capabilities. The Global Context Extraction Module (GCEM) obtains global context with different polyp sizes. Concurrently, the boundary Extraction Module (BEM) is capable of obtaining accurate boundaries in the presence of a large amount of background noise. Moreover, boundary information and residual information enhanced via the Uncertainty Residual Attention Module (URAM) are incorporated into the network to generate finer segmentation maps. Experimental results on five public datasets demonstrate that the proposed GCNet outperforms recent state-of-the-art competing methods. All code is available at https://github.com/dxqllp/GCNet.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+
from $39.99 /Month
  • Starting from 10 chapters or articles per month
  • Access and download chapters and articles from more than 300k books and 2,500 journals
  • Cancel anytime
View plans

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
eBook
USD 79.99
Price excludes VAT (USA)
Softcover Book
USD 99.99
Price excludes VAT (USA)

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Bernal, J., Sánchez, F.J., Fernández-Esparrach, G., Gil, D., Rodríguez, C., Vilariño, F.: WM-DOVA maps for accurate polyp highlighting in colonoscopy: validation versus saliency maps from physicians. Comput. Med. Imaging Graph. 43, 99–111 (2015)

    Google Scholar 

  2. Bernal, J., Sánchez, J., Vilarino, F.: Towards automatic polyp detection with a polyp appearance model. Pattern Recogn. 45(9), 3166–3182 (2012)

    Article  Google Scholar 

  3. Bretthauer, M., Løberg, M., Wieszczy, P., Kalager, M., Emilsson, L., Garborg, K., Rupinski, M., Dekker, E., Spaander, M., Bugajski, M., et al.: Effect of colonoscopy screening on risks of colorectal cancer and related death. N. Engl. J. Med. 387(17), 1547–1556 (2022)

    Article  Google Scholar 

  4. Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2017)

    Article  Google Scholar 

  5. Chen, S., Tan, X., Wang, B., Hu, X.: Reverse attention for salient object detection. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 234–250 (2018)

    Google Scholar 

  6. Cheng, B., Schwing, A., Kirillov, A.: Per-pixel classification is not all you need for semantic segmentation. Adv. Neural. Inf. Process. Syst. 34, 17864–17875 (2021)

    Google Scholar 

  7. Dong, B., Wang, W., Fan, D., Li, J., Fu, H., Shao, L.: Polyp-pvt: polyp segmentation with pyramid vision transformers (2021). arXiv:2108.06932

  8. Du, X., Xu, X., Ma, K.: ICGNet: integration context-based reverse-contour guidance network for polyp segmentation. In: Proceedings of the International Joint Conferences on Artificial Intelligence, pp. 877–883 (2022)

    Google Scholar 

  9. Fan, D.P., Ji, G.P., Zhou, T., Chen, G., Fu, H., Shen, J., Shao, L.: Pranet: Parallel reverse attention network for polyp segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 263–273. Springer (2020)

    Google Scholar 

  10. Fang, Y., Chen, C., Yuan, Y., Tong, K.V.: Selective feature aggregation network with area-boundary constraints for polyp segmentation. In: Medical Image Computing and Computer Assisted Intervention—MICCAI 2019: 22nd International Conference, Shenzhen, China, Proceedings, Part I 22. pp. 302–310. Springer (2019)

    Google Scholar 

  11. Gao, S.H., Cheng, M.M., Zhao, K., Zhang, X.Y., Yang, M.H., Torr, P.: Res2net: a new multi-scale backbone architecture. IEEE Trans. Pattern Anal. Mach. Intell. 43(2), 652–662 (2019)

    Article  Google Scholar 

  12. Guo, X., Yang, C., Liu, Y., Yuan, Y.: Learn to threshold: thresholdnet with confidence-guided manifold mixup for polyp segmentation. IEEE Trans. Med. Imaging 40(4), 1134–1146 (2020)

    Article  Google Scholar 

  13. Jha, D., Smedsrud, P.H., Riegler, M.A., Halvorsen, P., de Lange, T., Johansen, D., Johansen, H.D.: Kvasir-seg: A segmented polyp dataset. In: Multimedia Modeling: 26th International Conference, MMM 2020, Daejeon, South Korea, Proceedings, Part II 26, pp. 451–462. Springer (2020)

    Google Scholar 

  14. Jodal, H.C., Helsingen, L.M., Anderson, J.C., Lytvyn, L., Vandvik, P.O., Emilsson, L.: Colorectal cancer screening with faecal testing, sigmoidoscopy or colonoscopy: a systematic review and network meta-analysis. BMJ Open 9(10), e032773 (2019)

    Article  Google Scholar 

  15. Kim, T., Lee, H., Kim, D.: Uacanet: uncertainty augmented context attention for polyp segmentation. In: Proceedings of the 29th ACM International Conference on Multimedia, pp. 2167–2175 (2021)

    Google Scholar 

  16. Lin, T.Y., Dollar, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017)

    Google Scholar 

  17. Navarro, M., Nicolas, A., Ferrandez, A., Lanas, A.: Colorectal cancer population screening programs worldwide in 2016: an update. World J. Gastroenterol. 23(20), 3632 (2017)

    Article  Google Scholar 

  18. Nguyen, T.C., Nguyen, T.P., Diep, G.H., Tran-Dinh, A.H., Nguyen, T.V., Tran, M.T.: Ccbanet: cascading context and balancing attention for polyp segmentation. In: Medical Image Computing and Computer Assisted Intervention—MICCAI 2021: 24th International Conference, Strasbourg, France, Proceedings, Part I 24, pp. 633–643. Springer (2021)

    Google Scholar 

  19. Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, Proceedings, Part III 18, pp. 234–241. Springer (2015)

    Google Scholar 

  20. Silva, J., Histace, A., Romain, O., Dray, X., Granado, B.: Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer. Int. J. Comput. Assist. Radiol. Surg. 9, 283–293 (2014)

    Article  Google Scholar 

  21. Sung, H., Ferlay, J., Siegel, R.L., Laversanne, M., Soerjomataram, I., Jemal, A., Bray, F.: Global cancer statistics 2020: Globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: Cancer J. Clin. 71(3), 209–249 (2021)

    Google Scholar 

  22. Tajbakhsh, N., Gurudu, S.R., Liang, J.: Automated polyp detection in colonoscopy videos using shape and context information. IEEE Trans. Med. Imaging 35(2), 630–644 (2015)

    Article  Google Scholar 

  23. Tjaden, J.M., Hause, J.A., Berger, D., Duveneck, S.K., Jakate, S.M., Orkin, B.A., Hubbard, E.L., Melson, J.E.: Adenoma detection rate metrics in colorectal cancer surveillance colonoscopy. Surg. Endosc. 32, 3108–3113 (2018)

    Article  Google Scholar 

  24. Vázquez, D., Bernal, J., Sánchez, F.J., Fernández-Esparrach, G., López, A.M., Romero, A., Drozdzal, M., Courville, A., et al.: A benchmark for endoluminal scene segmentation of colonoscopy images. J. Healthc. Eng. 2017 (2017)

    Google Scholar 

  25. Wang, X., Girshick, R., Gupta, A., He, K.: Non-local neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7794–7803 (2018)

    Google Scholar 

  26. Xie, Q., Lai, Y.K., Wu, J., Wang, Z., Zhang, Y., Xu, K., Wang, J.: Mlcvnet: multi-level context votenet for 3d object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10447–10456 (2020)

    Google Scholar 

  27. Yang, M., Yu, K., Zhang, C., Li, Z., Yang, K.: Denseaspp for semantic segmentation in street scenes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3684–3692 (2018)

    Google Scholar 

  28. Yue, G., Han, W., Jiang, B., Zhou, T., Cong, R., Wang, T.: Boundary constraint network with cross layer feature integration for polyp segmentation. IEEE J. Biomed. Health Inform. 26(8), 4090–4099 (2022)

    Article  Google Scholar 

  29. Zauber, A.G., Winawer, S.J., O’Brien, M.J., Lansdorp-Vogelaar, I., van Ballegooijen, M., Hankey, B.F., Shi, W., Bond, J.H., Schapiro, M., Panish, J.F., et al.: Colonoscopic polypectomy and long-term prevention of colorectal-cancer deaths. N. Engl. J. Med. 366(8), 687–696 (2012)

    Article  Google Scholar 

  30. Zhang, R., Lai, P., Wan, X., Fan, D.J., Gao, F., Wu, X.J., Li, G.: Lesion-aware dynamic kernel for polyp segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 99–109. Springer (2022)

    Google Scholar 

  31. Zhang, R., Li, G., Li, Z., Cui, S., Qian, D., Yu, Y.: Adaptive context selection for polyp segmentation. In: Medical Image Computing and Computer Assisted Intervention—MICCAI 2020: 23rd International Conference, Lima, Peru, Proceedings, Part VI 23, pp. 253–262. Springer (2020)

    Google Scholar 

  32. Zhang, Z., Liu, Q., Wang, Y.: Road extraction by deep residual u-net. IEEE Geosci. Remote Sens. Lett. 15(5), 749–753 (2018)

    Article  Google Scholar 

  33. Zhao, X., Zhang, L., Lu, H.: Automatic polyp segmentation via multi-scale subtraction network. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, Proceedings, Part I 24, pp. 120–130. Springer (2021)

    Google Scholar 

  34. Zhou, T., Zhang, Y., Chen, G., Zhou, Y., Wu, Y., Fan, D.P.: Edge-aware feature aggregation network for polyp segmentation (2023). arXiv:2309.10523

  35. Zhou, T., Zhou, Y., He, K., Gong, C., Yang, J., Fu, H., Shen, D.: Cross-level feature aggregation network for polyp segmentation. Pattern Recogn. 140, 109555 (2023)

    Article  Google Scholar 

  36. Zhou, Z., Siddiquee, M.M.R., Tajbakhsh, N., Liang, J.: Unet++: redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans. Med. Imaging 39(6), 1856–1867 (2019)

    Article  Google Scholar 

  37. Zhu, X., Su, W., Lu, L., Li, B., Wang, X., Dai, J.: Deformable detr: deformable transformers for end-to-end object detection (2020). arXiv:2010.04159

Download references

Acknowledgments

The work was supported by Hefei Municipal Natural Science Foundation (2022009) and the High-performance Computing Platform of Anhui University for providing computing resources.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiuquan Du.

Editor information

Editors and Affiliations

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (zip 1342 KB) (download ZIP )

Rights and permissions

Reprints and permissions

Copyright information

© 2025 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, X., Chen, J., Gui, J., Du, X., Sha, W. (2025). GCNet: Global Context-Guided Uncertainty Boundary for Polyp Segmentation. In: Lin, Z., et al. Pattern Recognition and Computer Vision. PRCV 2024. Lecture Notes in Computer Science, vol 15045. Springer, Singapore. https://doi.org/10.1007/978-981-97-8499-8_14

Download citation

Keywords

Publish with us

Policies and ethics