The Wayback Machine - https://web.archive.org/web/20230315100601/https://github.com/topics/self-attention

#

self-attention

Here are 227 public repositories matching this topic...

datawhalechina / leedl-tutorial

《李宏毅深度学习教程》，PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

machine-learning reinforcement-learning deep-learning cnn transformer gan rnn pruning self-attention leedl-tutorial

Updated Feb 23, 2023
Jupyter Notebook

zhouhaoyi / Informer2020

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

deep-learning time-series pytorch transformer forecasting self-attention

Updated May 15, 2022
Python

PetarV- / GAT

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

python tensorflow neural-networks attention-mechanism graph-attention-networks self-attention

Updated Apr 9, 2022
Python

Diego999 / pyGAT

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

python pytorch neural-networks attention-mechanism graph-attention-networks self-attention

Updated Jun 21, 2022
Python

cmhungsteve / Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

computer-vision deep-learning transformers transformer awesome-list vit papers attention-mechanism attention-mechanisms self-attention transformer-architecture transformer-models detr vision-transformer transformer-cv transformer-with-cv transformer-awesome visual-transformer

Updated Mar 15, 2023

pytorch-GAT

gordicaleksa / pytorch-GAT

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

python deep-learning jupyter pytorch attention attention-mechanism graph-attention-networks self-attention pytorch-implementation gat graph-attention-network pytorch-gat gat-tutorial

Updated Nov 17, 2022
Jupyter Notebook

github / CodeSearchNet

Datasets, tools, and benchmarks for representation learning of code.

Updated Jan 31, 2022
Jupyter Notebook

speedinghzl / CCNet

CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).

pytorch segmentation semantic-segmentation cityscape self-attention scene-parsing

Updated Mar 19, 2021
Python

microsoft / DeBERTa

The implementation of DeBERTa

deeplearning representation-learning language-model bert natural-language-understanding self-attention roberta transformer-encoder

Updated Nov 30, 2022
Python

DirtyHarryLYL / Transformer-in-Vision

Recent Transformer-based CV and related works.

computer-vision deep-learning paper transformer visual-language multi-modal self-attention vision-transformers

Updated Mar 10, 2023

self-attention-cv

The-AI-Summer / self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

machine-learning deep-learning machine-learning-algorithms transformers artificial-intelligence transformer attention attention-mechanism self-attention

Updated Sep 14, 2021
Python

brightmart / bert_language_understanding

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

nlp text-classification question-answering document-classification transfer-learning fasttext language-model textcnn attention-is-all-you-need self-attention transformer-encoder bert-model pre-training language-understanding

Updated Jan 1, 2019
Python

awesome-fast-attention

Separius / awesome-fast-attention

list of efficient attention modules

awesome transformer attention attention-is-all-you-need multihead-attention reformer self-attention transformer-network longformer linformer

Updated Aug 23, 2021
Python

prakashpandey9 / Text-Classification-Pytorch

Text classification using deep learning models in Pytorch

text-classification pytorch lstm-model glove rnn-model sentiment-classification attention-model self-attention

Updated Nov 17, 2018
Python

kaituoxu / Speech-Transformer

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

end-to-end pytorch transformer attention asr attention-is-all-you-need self-attention

Updated May 7, 2020
Python

xxxnell / how-do-vits-work

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

pytorch transformer self-attention loss-landscape vision-transformer

Updated Jul 14, 2022
Python

daiquocnguyen / Graph-Transformer

Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)

text-classification transformer graph-machine-learning graph-embeddings graph-classification self-attention graph-neural-networks graph-representation-learning transformer-models node-embeddings graph-deep-learning graph-transformer

Updated Aug 16, 2022
Python

kaushalshetty / Structured-Self-Attention

A Structured Self-attentive Sentence Embedding

visualization deep-learning python3 pytorch classification attention attention-mechanism attention-model sentence-embeddings self-attentive-rnn self-attention attention-weights

Updated Sep 22, 2019
Python

jayparks / transformer

A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"

machine-translation attention-mechanism attention-is-all-you-need self-attention

Updated Oct 1, 2020
Python

leaderj1001 / Stand-Alone-Self-Attention

Implementing Stand-Alone Self-Attention in Vision Models using Pytorch

pytorch self-attention stand-alone-self-attention

Updated Feb 13, 2020
Python

Improve this page

Add a description, image, and links to the self-attention topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the self-attention topic, visit your repo's landing page and select "manage topics."