vision-transformers

Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

Recent Transformer-based CV and related works.

A collection of resources on applications of Transformers in Medical Imaging.

[NeurIPS 2021] DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification

Official PyTorch implementation of Fully Attentional Networks

EsViT: Efficient self-supervised Vision Transformers

[ICCV 2021 Oral] PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformers

🤗🖼️ HuggingPics: Fine-tune Vision Transformers for anything using images found on the web.

[Preprint] SeMask: Semantically Masked Transformers for Semantic Segmentation, 2021

Official implementation for the paper "Deep ViT Features as Dense Visual Descriptors".

Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification

A Monocular depth-estimation for in-the-wild AutoFocus application.

SimpleClick: Interactive Image Segmentation with Simple Vision Transformers

Official repository for "Self-Supervised Video Transformer" (CVPR'22)

Determine whether a given video sequence has been manipulated or synthetically generated

[NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang

Official implement of Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer

[ECCV 2022] "PPT: token-Pruned Pose Transformer for monocular and multi-view human pose estimation"

Includes PyTorch -> Keras model porting code for DeiT models with fine-tuning and inference notebooks.

Code for the paper "A Light Recipe to Train Robust Vision Transformers" [SaTML 2023]