A very good first issue IMO!

See huggingface/transformers#4829 (comment)

we should update the eval dataset to pick one start_position (or the most frequent one)

Optionally, use the huggingface/nlp library to get the eval dataset, and hook it into the Trainer.

Also referenced in huggingface/transformers#6997 (comment)

The usage example in the word2vec.py doc-comment regarding KeyedVectors uses inconsistent paths and thus doesn't work.

https://github.com/RaRe-Technologies/gensim/blob/e859c11f6f57bf3c883a718a9ab7067ac0c2d4cf/gensim/models/word2vec.py#L73

https://github.com/RaRe-Technologies/gensim/blob/e859c11f6f57bf3c883a718a9ab7067ac0c2d4cf/gensim/models/word2vec.py#L76

If vectors were saved to a tm

more details at: allenai/allennlp#2264 (comment)

Hi I would like to propose a better implementation for 'test_indices':

We can remove the unneeded np.array casting:

Cleaner/New:
test_indices = list(set(range(len(texts))) - set(train_indices))

Old:
test_indices = np.array(list(set(range(len(texts))) - set(train_indices)))