Speedup bert model inference

grayskripko March 5, 2020, 3:45pm 1

What are good and simple ways to make it fast enough on a server?

Topic		Replies	Views
BERT for classification error DeepPavlov Library	1	831	September 5, 2019
Анализ тональности с помощью rusentimet_convers_bert Models	10	966	October 13, 2021
New Release 0.5.0 Releases	0	535	July 29, 2019
Run Time Error Deeppavlov	3	172	July 27, 2023
FAQ models improvement DeepPavlov Library	3	478	November 25, 2019