The Wayback Machine - https://web.archive.org/web/20230315100613/https://github.com/topics/attention-mechanisms

#

attention-mechanisms

Here are 42 public repositories matching this topic...

lucidrains / PaLM-rlhf-pytorch

Sponsor

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

reinforcement-learning deep-learning transformers artificial-intelligence attention-mechanisms human-feedback

Updated Mar 13, 2023
Python

cmhungsteve / Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

computer-vision deep-learning transformers transformer awesome-list vit papers attention-mechanism attention-mechanisms self-attention transformer-architecture transformer-models detr vision-transformer transformer-cv transformer-with-cv transformer-awesome visual-transformer

Updated Mar 15, 2023

lucidrains / musiclm-pytorch

Sponsor

Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

deep-learning transformers artificial-intelligence attention-mechanisms music-synthesis

Updated Mar 6, 2023
Python

lucidrains / make-a-video-pytorch

Sponsor

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

deep-learning artificial-intelligence attention-mechanisms text-to-video axial-convolutions

Updated Dec 13, 2022
Python

lucidrains / audiolm-pytorch

Sponsor

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch

deep-learning transformers artificial-intelligence audio-synthesis attention-mechanisms

Updated Mar 10, 2023
Python

lucidrains / toolformer-pytorch

Sponsor

Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

deep-learning transformers artificial-intelligence attention-mechanisms api-calling

Updated Feb 27, 2023
Python

pprp / awesome-attention-mechanism-in-cv

Awesome List of Attention Modules and Plug&Play Modules in Computer Vision

computer-vision implementation attention-model attention-mechanisms pytorch-attention plugandplay vision-transformer

Updated Jan 22, 2023
Python

lucidrains / phenaki-pytorch

Sponsor

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

deep-learning transformers artificial-intelligence attention-mechanisms text-to-video imagination-machine

Updated Feb 13, 2023
Python

lucidrains / muse-maskgit-pytorch

Sponsor

Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch

deep-learning transformers artificial-intelligence text-to-image attention-mechanisms

Updated Mar 13, 2023
Python

JulesBelveze / time-series-autoencoder

📈 PyTorch Dual-Attention LSTM-Autoencoder For Multivariate Time Series 📈

time-series pytorch forecasting autoencoder multivariate-timeseries attention-mechanisms lstm-autoencoder

Updated Feb 26, 2023
Python

triplet-attention

landskape-ai / triplet-attention

Official PyTorch Implementation for "Rotate to Attend: Convolutional Triplet Attention Module." [WACV 2021]

computer-vision deep-learning paper detection imagenet convolutional-neural-networks arxiv attention-mechanism attention-mechanisms gradcam triplet-attention

Updated Sep 24, 2021
Jupyter Notebook

lucidrains / medical-chatgpt

Sponsor

Implementation of ChatGPT, but tailored towards primary care medicine, with the reward being able to collect patient histories in a thorough and efficient manner and come up with a reasonable differential diagnosis

medicine deep-learning transformers artificial-intelligence attention-mechanisms

Updated Feb 27, 2023
Python

cbaziotis / neat-vision

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

visualization nlp natural-language-processing vuejs deep-learning attention deep-learning-library attention-mechanism text-visualization attention-mechanisms deep-learning-visualization self-attentive-rnn self-attention attention-visualization attention-scores

Updated May 4, 2018
Vue

vene / sparse-structured-attention

Sparse and structured neural attention mechanisms

deep-neural-networks sparsity deep-learning sparse segmentation deeplearning attention-mechanism fused-lasso attention-mechanisms

Updated Aug 31, 2020
Python

lucidrains / robotic-transformer-pytorch

Sponsor

Implementation of RT1 (Robotic Transformer) in Pytorch

deep-learning robotics transformers artificial-intelligence attention-mechanisms

Updated Mar 8, 2023
Python

GiantPandaCV / yolov3-point

Learning YOLOv3 from scratch 从零开始学习YOLOv3代码

object-detection attention-mechanism plug-and-play attention-mechanisms yolov3

Updated Mar 14, 2022
Jupyter Notebook

lucidrains / Mega-pytorch

Sponsor

Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena

deep-learning artificial-intelligence exponential-moving-average attention-mechanisms long-range-arena

Updated Feb 19, 2023
Python

lucidrains / flash-cosine-sim-attention

Sponsor

Implementation of fused cosine similarity attention in the same style as Flash Attention

deep-learning artificial-intelligence attention-mechanisms

Updated Feb 13, 2023
Cuda

lucidrains / equiformer-pytorch

Sponsor

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and adopted for use by EquiFold for protein folding

deep-learning transformers artificial-intelligence molecules protein-folding attention-mechanisms equivariance

Updated Feb 13, 2023
Python

lucidrains / recurrent-interface-network-pytorch

Sponsor

Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in Pytorch

deep-learning artificial-intelligence image-generation attention-mechanisms video-generation denoising-diffusion latents

Updated Mar 5, 2023
Python

Improve this page

Add a description, image, and links to the attention-mechanisms topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the attention-mechanisms topic, visit your repo's landing page and select "manage topics."