The Wayback Machine - https://web.archive.org/web/20220426142627/https://github.com/topics/sparse-training

#

sparse-training

Here are 11 public repositories matching this topic...

google-research / rigl

End-to-end training of sparse deep neural networks with little-to-no performance loss.

machine-learning computer-vision neural-networks sparse-training

Updated Feb 2, 2022
Python

dcmocanu / sparse-evolutionary-artificial-neural-networks

Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).

deep-neural-networks sparsity deep-learning scalability randomization neuroevolution deep-learning-algorithms classification evolutionary-algorithms artificial-neural-networks restricted-boltzmann-machine complex-networks deep-learning-papers multi-layer-perceptron generative-models sparse-neural-networks scalable-deep-learning sparse-training sparse-evolutionary-training adaptive-sparse-connectivity

Updated Jul 21, 2021
Python

VITA-Group / SViTE

[NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang

pruning model-compression sparse-training vision-transformers efficient-transformers dynamic-sparsity token-slimming

Updated Jan 5, 2022
Python

Shiweiliuiiiiiii / In-Time-Over-Parameterization

[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy

sparsity deep-learning generalization sparse-training over-parameterization overparameterization in-time-overparameterization dynamic-sparse-training in-time-over-parameterization

Updated Feb 21, 2022
Python

zahraatashgahi / QuickSelection

Quick and Robust Feature Selection: the Strength of Energy-efficient Sparse Training for Autoencoders

sparsity deep-learning feature-selection autoencoder dimensionality-reduction denoising-autoencoders sparse-neural-networks sparse-training

Updated Feb 9, 2022
Python

IGITUGraz / SparseAdversarialTraining

Code for "Training Adversarially Robust Sparse Networks via Bayesian Connectivity Sampling" [ICML 2021]

adversarial-training adversarial-robustness sparse-training icml2021

Updated Mar 14, 2022
Python

Shiweiliuiiiiiii / Selfish-RNN

[ICML 2021] "Selfish Sparse RNN Training" by Shiwei Liu, Decebal Constantin Mocanu, Yulong Pei, Mykola Pechenizkiy

recurrent-neural-networks awd-lstm onlstm sparse-training dynamic-sparse-training awd-mos-lstm sparse-rnn-training

Updated Oct 8, 2021
Python

A-Klass / torch_topkast

Implementation of TopKAST as part of the "Applied Deep Learning for Pytorch and Tensorflow" course at LMU, Munich

deep-neural-networks sparsity deep-learning sparse-neural-networks sparse-training

Updated Aug 31, 2021
Python

GhadaSokar / Dynamic-Sparse-Training-for-Deep-Reinforcement-Learning

Implementation for the paper "Dynamic Sparse Training for Deep Reinforcement Learning" in PyTorch.

deep-neural-networks sparsity reinforcement-learning deep-learning deep-reinforcement-learning sparse-neural-networks sparse-training continuous-control-tasks

Updated Jan 28, 2022
Python

GhadaSokar / SpaceNet

Implementation for the paper "SpaceNet: Make Free Space For Continual Learning" in PyTorch.

deep-neural-networks deep-learning incremental-learning sparse-representations brain-inspired continual-learning catastrophic-forgetting sparse-neural-networks sparse-training life-long-learning

Updated Feb 28, 2021
Python

zahraatashgahi / CTRE

A Brain-inspired Algorithm for Training Highly Sparse Neural Networks

machine-learning sparsity deep-learning classification mlp sparse-neural-networks sparse-training

Updated Nov 8, 2021
Python

Improve this page

Add a description, image, and links to the sparse-training topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the sparse-training topic, visit your repo's landing page and select "manage topics."