Speedup bert model inference

grayskripko March 5, 2020, 3:45pm 1

What are good and simple ways to make it fast enough on a server?

Topic		Replies	Views
BERT for classification error DeepPavlov Library	1	778	September 5, 2019
Run Time Error Deeppavlov	3	133	July 27, 2023
FAQ models improvement DeepPavlov Library	3	439	November 25, 2019
Paraphrase detection model Models	4	1083	May 25, 2020
RuBERT и Tensorflow 2 DeepPavlov Library	1	1637	August 24, 2020