vision-transformer

CV backbones including GhostNet, TinyNet and TNT.

ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

This is a collection of our NAS and Vision Transformer work.

Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper

You Only Look at One Sequence (https://arxiv.org/abs/2106.00666)

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Pytorch version of Vision Transformer (ViT) with pretrained models. This is part of CASL (https://casl-project.github.io/) and ASYML project.

This is an official implementation for "Contextual Transformer Networks for Visual Recognition".

Explainability for Vision Transformers

Tensorflow implementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)

Global Filter Networks for Image Classification

pix2tex: Using a ViT to convert images of equations into LaTeX code.

The official code for the paper: https://arxiv.org/pdf/2108.00154.pdf

InterpretDL: Interpretation of Deep Learning Models，基于『飞桨』的模型可解释性算法库

Vision Transformer for 3D medical image registration (Pytorch).

PyTorch code of my ICDAR 2021 paper Vision Transformer for Fast and Efficient Scene Text Recognition (ViTSTR)

KoCLIP: Korean port of OpenAI CLIP, in Flax

Tensorflow implementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformer

Implementation of Convolutional enhanced image Transformer

CLIP: Connecting Text and Image (Learning Transferable Visual Models From Natural Language Supervision)

Code for ViTAS_Vision Transformer Architecture Search

Scenic: A Jax Library for Computer Vision and Beyond

Learning and Building Convolutional Neural Networks using PyTorch

Implementation of Image Classification using Visual Transformers in Amazon SageMaker based on the ideas from research paper - Visual Transformers: Token-based Image Representation and Processing for Computer Vision.

Tensorflow 2.x implementation of Vision-Transformer model

A collection of papers about Transformer in the field of medical image analysis.

Cassava leaf disease classification with CNNs and Vision Transformers (top-1% Kaggle solution)

The Tensorflow, Keras implementation of Swin-Transformer and Swin-UNET

The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-language transformer, video-language transformer and related datasets. Additionally, it also collects many useful tutorials and tools in these related domains.