Pinned

1. Chinese-BERT-wwm Public

   Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

   Python 8k 1.3k

2. Chinese-LLaMA-Alpaca Public

   中文LLaMA&Alpaca大语言模型+本地部署 (Chinese LLaMA & Alpaca LLMs)

   Python 821 59

3. MacBERT Public

   Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

   489 48

4. LERT Public

   LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）

   Python 114 7

5. airaria/TextBrewer Public

   A PyTorch-based knowledge distillation toolkit for natural language processing

   Python 1.3k 221

6. PERT Public

   PERT: Pre-training BERT with Permuted Language Model

   249 18