The Wayback Machine - https://web.archive.org/web/20240216041310/https://github.com/stas00
Skip to content
View stas00's full-sized avatar
1.2k followers · 4 following

Achievements

Achievement: Pull Sharkx4Achievement: Starstruckx4Achievement: Pair Extraordinairex4Achievement: QuickdrawAchievement: YOLOAchievement: Arctic Code Vault Contributor
BetaSend feedback

Achievements

Achievement: Pull Sharkx4Achievement: Starstruckx4Achievement: Pair Extraordinairex4Achievement: QuickdrawAchievement: YOLOAchievement: Arctic Code Vault Contributor
BetaSend feedback

Organizations

@bigscience-workshop
Block or Report

Block or report stas00

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
stas00/README.md

Pinned

  1. ml-engineering ml-engineering Public

    Machine Learning Engineering Open Book

    Python 8.4k 527

  2. porting porting Public

    Helper scripts and notes that were used while porting various nlp models

    Jupyter Notebook 40 6

  3. the-art-of-debugging the-art-of-debugging Public

    The Art of Debugging

    C 427 11

  4. git-tools git-tools Public

    helper git tools

    Shell 7

  5. ipyexperiments ipyexperiments Public

    Automatic GPU+CPU memory profiling, re-use and memory leaks detection using jupyter/ipython experiment containers

    Jupyter Notebook 184 11

  6. ml-ways ml-ways Public

    ML/DL Math and Method notes

    Jupyter Notebook 39 9

1,259 contributions in the last year

No contributions on February 12th.2 contributions on February 19th.1 contribution on February 26th.No contributions on March 5th.9 contributions on March 12th.1 contribution on March 19th.No contributions on March 26th.No contributions on April 2nd.No contributions on April 9th.No contributions on April 16th.No contributions on April 23rd.No contributions on April 30th.No contributions on May 7th.No contributions on May 14th.No contributions on May 21st.No contributions on May 28th.No contributions on June 4th.No contributions on June 11th.No contributions on June 18th.No contributions on June 25th.No contributions on July 2nd.No contributions on July 9th.No contributions on July 16th.1 contribution on July 23rd.3 contributions on July 30th.No contributions on August 6th.No contributions on August 13th.No contributions on August 20th.2 contributions on August 27th.No contributions on September 3rd.No contributions on September 10th.No contributions on September 17th.No contributions on September 24th.6 contributions on October 1st.No contributions on October 8th.No contributions on October 15th.31 contributions on October 22nd.8 contributions on October 29th.No contributions on November 5th.1 contribution on November 12th.No contributions on November 19th.No contributions on November 26th.9 contributions on December 3rd.No contributions on December 10th.No contributions on December 17th.No contributions on December 24th.4 contributions on December 31st.2 contributions on January 7th.5 contributions on January 14th.7 contributions on January 21st.1 contribution on January 28th.No contributions on February 4th.23 contributions on February 11th.11 contributions on February 13th.4 contributions on February 20th.4 contributions on February 27th.1 contribution on March 6th.11 contributions on March 13th.2 contributions on March 20th.4 contributions on March 27th.6 contributions on April 3rd.No contributions on April 10th.2 contributions on April 17th.No contributions on April 24th.1 contribution on May 1st.No contributions on May 8th.3 contributions on May 15th.1 contribution on May 22nd.3 contributions on May 29th.2 contributions on June 5th.No contributions on June 12th.No contributions on June 19th.1 contribution on June 26th.No contributions on July 3rd.5 contributions on July 10th.No contributions on July 17th.4 contributions on July 24th.2 contributions on July 31st.No contributions on August 7th.No contributions on August 14th.No contributions on August 21st.2 contributions on August 28th.3 contributions on September 4th.No contributions on September 11th.7 contributions on September 18th.5 contributions on September 25th.4 contributions on October 2nd.9 contributions on October 9th.2 contributions on October 16th.17 contributions on October 23rd.3 contributions on October 30th.8 contributions on November 6th.3 contributions on November 13th.7 contributions on November 20th.4 contributions on November 27th.5 contributions on December 4th.1 contribution on December 11th.4 contributions on December 18th.No contributions on December 25th.3 contributions on January 1st.5 contributions on January 8th.3 contributions on January 15th.8 contributions on January 22nd.4 contributions on January 29th.No contributions on February 5th.9 contributions on February 12th.10 contributions on February 14th.8 contributions on February 21st.10 contributions on February 28th.17 contributions on March 7th.11 contributions on March 14th.4 contributions on March 21st.3 contributions on March 28th.3 contributions on April 4th.3 contributions on April 11th.2 contributions on April 18th.9 contributions on April 25th.7 contributions on May 2nd.No contributions on May 9th.6 contributions on May 16th.No contributions on May 23rd.No contributions on May 30th.1 contribution on June 6th.5 contributions on June 13th.No contributions on June 20th.2 contributions on June 27th.No contributions on July 4th.No contributions on July 11th.1 contribution on July 18th.2 contributions on July 25th.No contributions on August 1st.No contributions on August 8th.No contributions on August 15th.No contributions on August 22nd.1 contribution on August 29th.4 contributions on September 5th.2 contributions on September 12th.8 contributions on September 19th.2 contributions on September 26th.7 contributions on October 3rd.8 contributions on October 10th.6 contributions on October 17th.8 contributions on October 24th.4 contributions on October 31st.9 contributions on November 7th.5 contributions on November 14th.No contributions on November 21st.No contributions on November 28th.1 contribution on December 5th.6 contributions on December 12th.2 contributions on December 19th.8 contributions on December 26th.6 contributions on January 2nd.2 contributions on January 9th.1 contribution on January 16th.7 contributions on January 23rd.1 contribution on January 30th.4 contributions on February 6th.5 contributions on February 13th.8 contributions on February 15th.1 contribution on February 22nd.14 contributions on March 1st.24 contributions on March 8th.6 contributions on March 15th.7 contributions on March 22nd.6 contributions on March 29th.3 contributions on April 5th.3 contributions on April 12th.7 contributions on April 19th.3 contributions on April 26th.4 contributions on May 3rd.1 contribution on May 10th.3 contributions on May 17th.No contributions on May 24th.3 contributions on May 31st.1 contribution on June 7th.2 contributions on June 14th.No contributions on June 21st.3 contributions on June 28th.No contributions on July 5th.4 contributions on July 12th.2 contributions on July 19th.3 contributions on July 26th.2 contributions on August 2nd.No contributions on August 9th.No contributions on August 16th.1 contribution on August 23rd.2 contributions on August 30th.2 contributions on September 6th.No contributions on September 13th.10 contributions on September 20th.1 contribution on September 27th.8 contributions on October 4th.8 contributions on October 11th.4 contributions on October 18th.9 contributions on October 25th.8 contributions on November 1st.8 contributions on November 8th.7 contributions on November 15th.No contributions on November 22nd.4 contributions on November 29th.3 contributions on December 6th.2 contributions on December 13th.11 contributions on December 20th.5 contributions on December 27th.11 contributions on January 3rd.9 contributions on January 10th.9 contributions on January 17th.6 contributions on January 24th.1 contribution on January 31st.3 contributions on February 7th.15 contributions on February 14th.4 contributions on February 16th.5 contributions on February 23rd.14 contributions on March 2nd.3 contributions on March 9th.3 contributions on March 16th.2 contributions on March 23rd.3 contributions on March 30th.4 contributions on April 6th.5 contributions on April 13th.4 contributions on April 20th.5 contributions on April 27th.2 contributions on May 4th.5 contributions on May 11th.2 contributions on May 18th.3 contributions on May 25th.No contributions on June 1st.4 contributions on June 8th.4 contributions on June 15th.No contributions on June 22nd.3 contributions on June 29th.No contributions on July 6th.2 contributions on July 13th.2 contributions on July 20th.2 contributions on July 27th.No contributions on August 3rd.No contributions on August 10th.No contributions on August 17th.2 contributions on August 24th.No contributions on August 31st.7 contributions on September 7th.1 contribution on September 14th.3 contributions on September 21st.5 contributions on September 28th.1 contribution on October 5th.3 contributions on October 12th.2 contributions on October 19th.13 contributions on October 26th.7 contributions on November 2nd.1 contribution on November 9th.No contributions on November 16th.11 contributions on November 23rd.1 contribution on November 30th.4 contributions on December 7th.13 contributions on December 14th.6 contributions on December 21st.12 contributions on December 28th.5 contributions on January 4th.2 contributions on January 11th.2 contributions on January 18th.1 contribution on January 25th.3 contributions on February 1st.8 contributions on February 8th.8 contributions on February 15th.7 contributions on February 17th.10 contributions on February 24th.5 contributions on March 3rd.12 contributions on March 10th.10 contributions on March 17th.7 contributions on March 24th.1 contribution on March 31st.No contributions on April 7th.3 contributions on April 14th.5 contributions on April 21st.3 contributions on April 28th.4 contributions on May 5th.1 contribution on May 12th.3 contributions on May 19th.2 contributions on May 26th.No contributions on June 2nd.3 contributions on June 9th.No contributions on June 16th.No contributions on June 23rd.2 contributions on June 30th.1 contribution on July 7th.No contributions on July 14th.3 contributions on July 21st.1 contribution on July 28th.No contributions on August 4th.No contributions on August 11th.6 contributions on August 18th.2 contributions on August 25th.No contributions on September 1st.5 contributions on September 8th.2 contributions on September 15th.10 contributions on September 22nd.8 contributions on September 29th.6 contributions on October 6th.14 contributions on October 13th.No contributions on October 20th.5 contributions on October 27th.10 contributions on November 3rd.5 contributions on November 10th.2 contributions on November 17th.No contributions on November 24th.4 contributions on December 1st.No contributions on December 8th.4 contributions on December 15th.4 contributions on December 22nd.3 contributions on December 29th.6 contributions on January 5th.No contributions on January 12th.6 contributions on January 19th.No contributions on January 26th.6 contributions on February 2nd.2 contributions on February 9th.No contributions on February 16th.No contributions on February 18th.7 contributions on February 25th.No contributions on March 4th.No contributions on March 11th.1 contribution on March 18th.1 contribution on March 25th.No contributions on April 1st.No contributions on April 8th.No contributions on April 15th.No contributions on April 22nd.No contributions on April 29th.No contributions on May 6th.No contributions on May 13th.No contributions on May 20th.No contributions on May 27th.2 contributions on June 3rd.No contributions on June 10th.No contributions on June 17th.No contributions on June 24th.28 contributions on July 1st.No contributions on July 8th.No contributions on July 15th.2 contributions on July 22nd.1 contribution on July 29th.No contributions on August 5th.No contributions on August 12th.No contributions on August 19th.No contributions on August 26th.No contributions on September 2nd.1 contribution on September 9th.No contributions on September 16th.No contributions on September 23rd.3 contributions on September 30th.3 contributions on October 7th.2 contributions on October 14th.No contributions on October 21st.No contributions on October 28th.No contributions on November 4th.1 contribution on November 11th.No contributions on November 18th.No contributions on November 25th.9 contributions on December 2nd.No contributions on December 9th.No contributions on December 16th.3 contributions on December 23rd.2 contributions on December 30th.1 contribution on January 6th.11 contributions on January 13th.No contributions on January 20th.1 contribution on January 27th.5 contributions on February 3rd.13 contributions on February 10th.
Contribution Graph
Day of Week February March April May June July August September October November December January February
Sunday
Monday
Tuesday
Wednesday
Thursday
Friday
Saturday
Learn how we count contributions
Less
No contributions.
Low contributions.
Medium-low contributions.
Medium-high contributions.
High contributions.
More

Activity overview

Contributed to stas00/ml-engineering, huggingface/transformers, stas00/the-art-of-debugging and 58 other repositories
A graph representing stas00's contributions from February 12, 2023 to February 16, 2024. The contributions are 65% commits, 16% pull requests, 12% code review, 7% issues.

Contribution activity

February 2024

Created 80 commits in 3 repositories
Created 1 repository

Created a pull request in EleutherAI/cookbook that received 2 comments

[sizing] fixes and enhancements

This PR: fixes: File "/data/stas/benchmarks/cookbook/benchmarks/sizing/mm_flops.py", line 47, in <module> with open(args.output_file, 'w') as sy…

+106 −48 lines changed • 2 comments
Opened 2 other pull requests in 2 repositories
EleutherAI/cookbook 1 merged
stas00/ml-engineering 1 merged
  • Reorg 2
    This contribution was made on Feb 12
Reviewed 2 pull requests in 2 repositories
microsoft/DeepSpeed 1 pull request
stas00/ml-engineering 1 pull request

Created an issue in microsoft/DeepSpeed that received 4 comments

[REQUEST] ZeRO - introduce replicas to keep GBS from getting too large on hundres of gpus

Currently the GBS blows up to thousands if MBS is more than 1, which is counter-productive to training. And as clusters become larger and the train…

4 comments
17 contributions in private repositories Feb 1 – Feb 14