Speedup bert model inference

grayskripko March 5, 2020, 3:45pm 1

What are good and simple ways to make it fast enough on a server?

Topic		Replies	Views
BERT for classification error DeepPavlov Library	1	826	September 5, 2019
Анализ тональности с помощью rusentimet_convers_bert Models	10	945	October 13, 2021
New Release 0.5.0 Releases	0	532	July 29, 2019
Run Time Error Deeppavlov	3	168	July 27, 2023
FAQ models improvement DeepPavlov Library	3	478	November 25, 2019