LoRA and quantization are applied to the models - #4

Open

khoda81 wants to merge 9 commits into

mainfrom

quantized-model

Commits on Oct 22, 2024

LoRA and quantization are applied to the models
ghazalgca
committed
b8582f5

Commits on Oct 27, 2024

Add reward scaling
khoda81
committed
3c3925e
Ignoring `,env`
khoda81
committed
ff061a6
Refactor reward scaling
khoda81
committed
3adb935
Add notes for future experiments
khoda81
committed
eb9e6cb
Ready to merge
khoda81
committed
d4a98bb

Commits on Nov 26, 2024

Merge branch 'V1' into quantized-model
khoda81
committed
c0986f7
Add reward normalization
khoda81
committed
01c6e00

Commits on Jan 22, 2025

Implement reward normalization
khoda81
committed
8f767ea