[readability] Consolidate prune_heads logic to PretrainedModel. Good First Issue Help wanted PyTorch

#3825 opened Apr 16, 2020 by sshleifer

5

`BertTokenizer.from_pretrained()` not working with native Python `pathlib` module Good First Issue

#3962 opened Apr 25, 2020 by macwanj

3

run_bertology: AttributeError: 'NoneType' object has no attribute 'abs' Good First Issue

#3895 opened Apr 22, 2020 by ThomasSYT

6

Type Hints for modeling_utils.py Good First Issue

#3911 opened Apr 23, 2020 by sshleifer

Replace `config.output_hidden_states` parameter with function argument `output_hidden_states` Good First Issue

#3879 opened Apr 21, 2020 by patrickvonplaten

Replace `config.output_attentions` parameter with function argument `output_attentions` Good First Issue

#3880 opened Apr 21, 2020 by patrickvonplaten

2

Adding mbart-large-cc25 Documentation New model

#3513 opened Mar 29, 2020 by maksym-del

4

[docs] Provide a barebones GPT-2 colab notebook Documentation

#3045 opened Feb 27, 2020 by aolko

13

Repository with recipes how to pretrain model from scratch on my own data Documentation

#2814 opened Feb 11, 2020 by ksopyla

16

GPT2LMHeadModel Documentation Mismatch for labels

#4047 opened Apr 28, 2020 by cdpierse

2

[readability] consolidate examples/summarization/bart and examples/summarization/t5 Examples Help wanted Summarization

#3826 opened Apr 16, 2020 by sshleifer

Provide comprehensive guide & best-practices for run_language_modeling.py Ex: LM (Finetuning) Ex: LM (Pretraining)

#3192 opened Mar 9, 2020 by marrrcin

4

BertForSequenceClassification is not optimum

#3952 opened Apr 24, 2020 by RodSernaPerez

Tests for more examples

#3483 opened Mar 27, 2020 by srush

3

A bug in the padding of input examples in the NER fine-tuning example

#3814 opened Apr 15, 2020 by AMR-KELEG

8

Do I need to pad non-fixed examples or does run_language_modeling.py already takes care of that?

#3481 opened Mar 27, 2020 by timsoraro

12

Input file format for examples/run_lm_finetuning.py

#2693 opened Jan 31, 2020 by nminds

10

CTRL generates French text when I want English texts Ex: Generation

#3597 opened Apr 2, 2020 by AdaUchendu

2

After reading the tutorial I can use the BertModel to extract word embedding but how to use it extract the sentence embedding?

#3949 opened Apr 24, 2020 by leopardv10

1

Add code to pretrain T5 model from scratch

#3624 opened Apr 3, 2020 by LiweiPeng

1