mihaimasala commited on
Commit
37da059
·
verified ·
1 Parent(s): 2dac433

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -6
README.md CHANGED
@@ -13,24 +13,32 @@ We value:
13
  - using public and open corpora
14
  - open-source training and evaluation code.
15
 
16
- In this organization, you can find RoLLM models, based on different underlying models and in different flavours (i.e., foundational, instruct, or chat variants). There are currently four model collections:
17
  - RoLlama2: Romanian models based on Llama2
18
  - RoMistral: Romanian models based on Mistral
19
  - RoLlama3: Romanian models based on Llama3
20
  - RoLlama3.1: Romanian models based on Llama3.1
21
  - RoGemma: Romanian models based on Gemma
22
  - RoGemma2: Romanian models based on Gemma2
 
 
 
 
 
23
 
24
 
25
- Furthermore, here you can find data used to train and evaluate LLMs in Romanian. Currently, there are three data collections:
 
26
  - SFT datasets: data used for supervised (instruction) finetuning
27
  - Alignment datasets: data used mainly for Direct Preference Optimization (DPO)
28
- - Evaluation datasets: data used for evaluating LLM in Romanian
29
 
30
- See details in [https://arxiv.org/abs/2406.18266](https://arxiv.org/abs/2406.18266) and [https://arxiv.org/abs/2405.07703](https://arxiv.org/abs/2405.07703).
31
-
32
- - 2025-04-23: we increased the datasets used for supervised finetuning with high-quality data generated using Magpie ([RoMagpie-Reasoning](https://huggingface.co/datasets/OpenLLM-Ro/ro_sft_magpie_reasoning) and [RoMagpie-Pro-MT](https://huggingface.co/datasets/OpenLLM-Ro/ro_sft_magpie_mt)), and greatly increase the size of the alignment dataset by adding high-quality datasets ([RoUltraFeedback](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_ultrafeedback), [RoMagpie-DPO](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_magpie), [RoArgillaMagpieUltra](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_argilla_magpie) and [RoHelpSteer2](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_helpsteer2))
33
 
 
 
 
 
34
  We encourage the community to engage in discussions (to provide feedback, ask questions, or make improvement suggestions) in Hugging Face or GitHub.
35
 
36
  We will also organize physical meetings (announced in advance) to brainstorm ideas, roadmap, and other technical aspects.
 
13
  - using public and open corpora
14
  - open-source training and evaluation code.
15
 
16
+ In this organization, you can find RoLLM models, based on different underlying models and in different flavours (i.e., foundational, instruct, or chat variants):
17
  - RoLlama2: Romanian models based on Llama2
18
  - RoMistral: Romanian models based on Mistral
19
  - RoLlama3: Romanian models based on Llama3
20
  - RoLlama3.1: Romanian models based on Llama3.1
21
  - RoGemma: Romanian models based on Gemma
22
  - RoGemma2: Romanian models based on Gemma2
23
+ - RoLlava: Romanian models based on Llava
24
+ - RoQwen2-VL: Romanian models based on Qwen2-VL
25
+ - RoQwen2.5-VL: Romanian models based on Qwen2.5-VL
26
+ - RoQwen3-VL: Romanian models based on Qwen3-VL
27
+ - RoGemma3: Romanian models based on Gemma3
28
 
29
 
30
+ Furthermore, here you can find data used to train and evaluate LLMs & VLMs in Romanian. Currently, there are four data collections:
31
+ - Pretraining dataset: Romanian pretraining quality-filtered data
32
  - SFT datasets: data used for supervised (instruction) finetuning
33
  - Alignment datasets: data used mainly for Direct Preference Optimization (DPO)
34
+ - Evaluation datasets: data used for evaluating models in Romanian
35
 
36
+ See details in [https://arxiv.org/abs/2406.18266](https://arxiv.org/abs/2406.18266) and [https://arxiv.org/abs/2605.31401](https://arxiv.org/abs/2605.31401).
 
 
37
 
38
+ - 23-04-2025: we increased the datasets used for supervised finetuning with high-quality data generated using Magpie ([RoMagpie-Reasoning](https://huggingface.co/datasets/OpenLLM-Ro/ro_sft_magpie_reasoning) and [RoMagpie-Pro-MT](https://huggingface.co/datasets/OpenLLM-Ro/ro_sft_magpie_mt)), and greatly increase the size of the alignment dataset by adding high-quality datasets ([RoUltraFeedback](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_ultrafeedback), [RoMagpie-DPO](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_magpie), [RoArgillaMagpieUltra](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_argilla_magpie) and [RoHelpSteer2](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_helpsteer2))
39
+ - 28-11-2025: we release augmented pretraining data and quality classifier
40
+ - 05-06-2026: we release RoVLMs together with training and evaluation data
41
+ -
42
  We encourage the community to engage in discussions (to provide feedback, ask questions, or make improvement suggestions) in Hugging Face or GitHub.
43
 
44
  We will also organize physical meetings (announced in advance) to brainstorm ideas, roadmap, and other technical aspects.