Skip to content

strfry/prussian-lora

Repository files navigation

Lauf 19.5.26 Stage a

.venv/bin/python scaffolding/train_stage2.py --model utter-project/EuroLLM-1.7B-Instruct --src-lang miks
--limit 1000 --epochs 2 --lora-targets all --r 16 --output-dir out/stage2a_format

20.5.26 Abbruch: versehentlich auf 1.7B ohne stage1 trainiert

.venv/bin/python scaffolding/train_stage2.py --model utter-project/EuroLLM-9B-Instruct-2512 --src-lang miks
--quantize int4 --enable-qlora
--limit 1000 --epochs 2 --lora-target all --r 4 --output-dir out/stage2.1a_format --merge-adapter out/lora_EuroLLM-9B-Instruct-2512/checkpoint-100/

Lauf b geplant:

.venv/bin/python scaffolding/train_stage2.py
--merge-adapter out/stage2a_format/checkpoint-XXX
--src-lang miks --r 128 --lora-targets ffn --epochs 1
--output-dir out/stage2b_vocab

b lauf auf base 2.1a

About

Multi-stage LoRA pipeline for Old Prussian translation (Palmaitis/Klussis) on EuroLLM

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages