Training Pre-trained Model in Deeppavlov

1

Hi

I am training a pre-trained BioBert model with squad.

I want to know how Deeppavlov trains a pre-trained model and does it freeze/reuse any of the previously trained layers?

Thankyou!

1 Like
2

Hi!

All model parameters from the pre-trained model will be reused during finetuning.

3

Okay Got it!
thank you