transformer
Here are 480 public repositories matching this topic...
Natural Language Processing Tutorial for Deep Learning Researchers
-
Updated
Jan 27, 2020 - Jupyter Notebook
chooses 15% of token
PositionalEmbedding
viewpager with parallax pages, together with vertical sliding (or click) and activity transition
-
Updated
Jan 26, 2020 - Java
y_hat should be [N, t], and tf.reduce_sum(y_hat, 1) should be [N,], I can't understand this if statement. And decoder_inputs should be [N, t], i think tf.concat((decoder_inputs, y_hat), 1) is wrong, should it be changed to tf.concat((decoder_inputs, y_hat[:,-1]), 1)
saver error occors
Chinese version of GPT2 training code, using BERT tokenizer.
-
Updated
Jan 26, 2020 - Python
Since Trax is a successor of tensor2tensor (according to the release notes of tensor2tensor v1.15.0), it would be helpful if you could provide examples for more advanced machine learning tasks. An outstanding feature of tensor2tensor are the numerous (and useful) examples which Trax is currently lacking. Such examples would especi
Hi, we have some of your regex's in AllenNLP and Python has been warning us about them for a while.
https://github.com/huggingface/pytorch-openai-transformer-lm/blob/master/text_utils.py#L30
'''(-+|~+|!+|"+|;+|\?+|\++|,+|\)+|\(+|\\+|\/+|\*+|\[+|\]+|}+|{+|\|+|_+)'''<input>:1: DeprecationWarning: invalid escape sequence \?
<input>:1: DeprecationWarning: invalid escape sequence \?
<input
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
-
Updated
Jan 27, 2020 - Jupyter Notebook
Keras implementation of BERT with pre-trained weights
-
Updated
Jan 17, 2020 - Python
微博,微信图库效果,微信视频拖放效果,适配状态栏 、屏幕旋转 、全屏 、长图、GIF、视频
-
Updated
Jan 23, 2020 - Java
Setting config `filter_fields_parameter` to null doesn't disable query string fieldset filtering
Responder version: 3.0.5
Laravel version: v5.5.45
In the config file, the documentation for filter_fields_parameter says:
The package can automatically filter the fields of transformed data from a query string parameter configured below. The technique is also known as sparse fieldsets. Set it to null to disable it.
However, when setting it to null I started getting `Array to string
In ZoomOutSlideTransformer if you have a page that has full size content, i.e. no margins, the content is partly visible in the pages next to it when they are currently shown. The issue can be seen in the provided screenshot.
As you can see, on the right side you can se half transparent images of the next page.
 must be of the type array, string given, called in /var/www/html/..../vendor/nilportugues/laravel5-json-api/src/NilPortugues/Laravel5/JsonApi/Mapper/Mapper.php on line 2
GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)
-
Updated
Jan 22, 2020 - Python
CTR prediction models based on deep learning(基于深度学习的广告推荐CTR预估模型)
-
Updated
Jan 22, 2020 - Python
TensorFlow implementation of 'Attention Is All You Need (2017. 6)'
-
Updated
Jan 10, 2020 - Python
The space after the end of the paragraph.
https://developer.apple.com/documentation/uikit/nsmutableparagraphstyle/1532528-paragraphspacing
After migrate from Expo SDK32 to Expo SDK35 I get an error - 'Unable to resolve "react-native-svg" from "assets / icon / cancel-exit.svg"'. I installed the library as you write in the readme file.
My package.json is the following:
"dependencies": {
"expo": "^35.0.0",
"expo-asset": "~7.0.0",
"expo-camera": "~7.0.0",
"expo-constants": "~7.0.0",
"expo-file-system": "~7.0.
Improve this page
Add a description, image, and links to the transformer topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the transformer topic, visit your repo's landing page and select "manage topics."



From paper, it mentioned
It means that 15% of token will be choose for sure.
From https://github.com/codertimo/BERT-pytorch/blob/master/bert_pytorch/dataset/dataset.py#L68,
for every single token, it has 15% of chance that go though the followup procedure.