Add Russian-language capability (two-stage LoRA)

#12
by jbakerx - opened

Stage A (Language adaptation): Train a LoRA on general high-quality Russian text (news/books/Wikipedia) to teach vocabulary + grammar.

Stage B (Style specialization): Continue training from Stage A LoRA on Tolstoy/Dostoevsky/Chekhov Russian works (public domain) to transfer the “literary realism” style in Russian.
Why: if you jump straight to Russian literature style, the model may struggle with basic Russian fluency.

We will consider this enhancement for inclusion in version 2.0.0.

Sign up or log in to comment