Support for LLaDA 2.1

[Haru-LCY]

Hi there,

First of all, thank you so much for this amazing project!

I’m reaching out because I noticed that the current version seems to support up to LLaDA 2.0. I’m really excited to try fine-tuning the new LLaDA 2.1 models, but I’m not sure if the current scripts are fully compatible yet. Could you please provide or update the training code/scripts to support LLaDA 2.1?

Looking forward to your thoughts! Thanks again for your hard work on this.

[giladturok]

Bumping this! And thank you for all your amazing hard work on this!!

[Prepanpan]

I am waiting for this too ;) Thanks for all your amazing hard work on this

[Lh-Ty]

+1, looking forward to LLaDA 2.1 support as well! Thanks for the great work.