-
University of Washington
- Seattle, USA
- https://timdettmers.com/
- @tim_dettmers
Block or Report
Block or report TimDettmers
Report abuse
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
Report abusePinned
691 contributions in the last year
Less
More
Contribution activity
May 2023
Created 33 commits in 5 repositories
Created 2 repositories
- TimDettmers/peft Python
- TimDettmers/transformers Python
Created a pull request in huggingface/transformers that received 8 comments
Bugfix: LLaMA layer norm incorrectly changes input type and consumers lots of memory
What does this PR do?
It is a common setup to run LLaMA in bfloat16 or float16 while the RMSNorm layers are in float32. The current implementation …
+4
−10
•
8
comments
Opened 4 other pull requests in 3 repositories
huggingface/transformers
2
merged
huggingface/accelerate
1
merged
huggingface/peft
1
merged
Reviewed 3 pull requests in 3 repositories
huggingface/blog
1 pull request
huggingface/accelerate
1 pull request
huggingface/transformers
1 pull request
3
contributions
in private repositories
May 26





