A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
-
Updated
Oct 22, 2020 - Python
The original PyTorch implementation of TabularDropout transformation is available at transformers4rec/torch/tabular/transformations.py
Add a description, image, and links to the xlnet topic page so that developers can more easily learn about it.
To associate your repository with the xlnet topic, visit your repo's landing page and select "manage topics."
setting
pretrained_model_namewill not only define the model arch but also load the pre-trained checkpoint. We should have anotherhparamto control whether to load pre-trained checkpoint or not.