Huggingface trl implementation code

[taemin6697]

I looked at the code in Hugging Face TRL, and it seems that a feature like layer dropout is not implemented. Is it still in an unimplemented state?

[jiogenes]

Unfortunately, yes... They haven't implemented training code. Refer #1

[taemin6697]

I've done some of the implementation, and it works well as a result. This code might not be a perfect implementation, but I think it's similar.

model.txt
model_grad.txt