About the code of re-initializing the top layer(s) before fine-tuning

[LYPinASR]

Hello!
Could you please show the code of re-initializing the top layer(s) before fine-tuning?
Thank you!

[jjery2243542]

Hi, the fine-tuning is done separately. I use speechbrain to fine-tune with this pytorch module, but with the module, it should be easy to fine-tune it without speechbrain (can be done in huggingface I believe). My huggingface transformers version is (4.6.0.dev0). You can find the code for re-init in L185-191.

[LYPinASR]

Thanks for your reply! However, the link of "pytorch module" is invalid for me. Could you please send me the corresponding codes?

[jjery2243542]

Hi, I just make it public. Please try again.