roberta

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

RoBERTa中文预训练模型: RoBERTa for Chinese

🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型集合

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

news-please - an integrated web crawler and information extractor for news that just works

The implementation of DeBERTa

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)