Speedup bert model inference

grayskripko March 5, 2020, 3:45pm 1

What are good and simple ways to make it fast enough on a server?

Topic		Replies	Views
Многопоточность и контроль использования ОЗУ в режиме riseapi DeepPavlov Library	2	433	November 16, 2020
About the Models category Models	0	337	May 29, 2020
Offline with Docker Documentation	1	2446	March 3, 2020
DeepPavlov Available on NGC Announcements	0	413	August 25, 2020
About the Documentation category Documentation	0	307	May 29, 2020