Rubert Embeddings

DeepPavlov Library Documentation
1

Hi, all!

Wish to use embeddings from rubert. The same way as Multilingual pretrained model bert from https://github.com/google-research/bert/blob/master/multilingual.md .
Could you share a link to not fine-tuned model? Just for embeddings

Thank you very much 4 your work!
Best regards,
KonArt

2

Hi @KonArt,

Thank you for your kind words!
You can find the pretrained rubert model here: http://files.deeppavlov.ai/deeppavlov_data/bert/rubert_cased_L-12_H-768_A-12_v2.tar.gz