Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -13,24 +13,32 @@ We value:
|
|
| 13 |
- using public and open corpora
|
| 14 |
- open-source training and evaluation code.
|
| 15 |
|
| 16 |
-
In this organization, you can find RoLLM models, based on different underlying models and in different flavours (i.e., foundational, instruct, or chat variants)
|
| 17 |
- RoLlama2: Romanian models based on Llama2
|
| 18 |
- RoMistral: Romanian models based on Mistral
|
| 19 |
- RoLlama3: Romanian models based on Llama3
|
| 20 |
- RoLlama3.1: Romanian models based on Llama3.1
|
| 21 |
- RoGemma: Romanian models based on Gemma
|
| 22 |
- RoGemma2: Romanian models based on Gemma2
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
|
| 24 |
|
| 25 |
-
Furthermore, here you can find data used to train and evaluate LLMs in Romanian. Currently, there are
|
|
|
|
| 26 |
- SFT datasets: data used for supervised (instruction) finetuning
|
| 27 |
- Alignment datasets: data used mainly for Direct Preference Optimization (DPO)
|
| 28 |
-
- Evaluation datasets: data used for evaluating
|
| 29 |
|
| 30 |
-
See details in [https://arxiv.org/abs/2406.18266](https://arxiv.org/abs/2406.18266) and [https://arxiv.org/abs/
|
| 31 |
-
|
| 32 |
-
- 2025-04-23: we increased the datasets used for supervised finetuning with high-quality data generated using Magpie ([RoMagpie-Reasoning](https://huggingface.co/datasets/OpenLLM-Ro/ro_sft_magpie_reasoning) and [RoMagpie-Pro-MT](https://huggingface.co/datasets/OpenLLM-Ro/ro_sft_magpie_mt)), and greatly increase the size of the alignment dataset by adding high-quality datasets ([RoUltraFeedback](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_ultrafeedback), [RoMagpie-DPO](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_magpie), [RoArgillaMagpieUltra](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_argilla_magpie) and [RoHelpSteer2](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_helpsteer2))
|
| 33 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
We encourage the community to engage in discussions (to provide feedback, ask questions, or make improvement suggestions) in Hugging Face or GitHub.
|
| 35 |
|
| 36 |
We will also organize physical meetings (announced in advance) to brainstorm ideas, roadmap, and other technical aspects.
|
|
|
|
| 13 |
- using public and open corpora
|
| 14 |
- open-source training and evaluation code.
|
| 15 |
|
| 16 |
+
In this organization, you can find RoLLM models, based on different underlying models and in different flavours (i.e., foundational, instruct, or chat variants):
|
| 17 |
- RoLlama2: Romanian models based on Llama2
|
| 18 |
- RoMistral: Romanian models based on Mistral
|
| 19 |
- RoLlama3: Romanian models based on Llama3
|
| 20 |
- RoLlama3.1: Romanian models based on Llama3.1
|
| 21 |
- RoGemma: Romanian models based on Gemma
|
| 22 |
- RoGemma2: Romanian models based on Gemma2
|
| 23 |
+
- RoLlava: Romanian models based on Llava
|
| 24 |
+
- RoQwen2-VL: Romanian models based on Qwen2-VL
|
| 25 |
+
- RoQwen2.5-VL: Romanian models based on Qwen2.5-VL
|
| 26 |
+
- RoQwen3-VL: Romanian models based on Qwen3-VL
|
| 27 |
+
- RoGemma3: Romanian models based on Gemma3
|
| 28 |
|
| 29 |
|
| 30 |
+
Furthermore, here you can find data used to train and evaluate LLMs & VLMs in Romanian. Currently, there are four data collections:
|
| 31 |
+
- Pretraining dataset: Romanian pretraining quality-filtered data
|
| 32 |
- SFT datasets: data used for supervised (instruction) finetuning
|
| 33 |
- Alignment datasets: data used mainly for Direct Preference Optimization (DPO)
|
| 34 |
+
- Evaluation datasets: data used for evaluating models in Romanian
|
| 35 |
|
| 36 |
+
See details in [https://arxiv.org/abs/2406.18266](https://arxiv.org/abs/2406.18266) and [https://arxiv.org/abs/2605.31401](https://arxiv.org/abs/2605.31401).
|
|
|
|
|
|
|
| 37 |
|
| 38 |
+
- 23-04-2025: we increased the datasets used for supervised finetuning with high-quality data generated using Magpie ([RoMagpie-Reasoning](https://huggingface.co/datasets/OpenLLM-Ro/ro_sft_magpie_reasoning) and [RoMagpie-Pro-MT](https://huggingface.co/datasets/OpenLLM-Ro/ro_sft_magpie_mt)), and greatly increase the size of the alignment dataset by adding high-quality datasets ([RoUltraFeedback](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_ultrafeedback), [RoMagpie-DPO](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_magpie), [RoArgillaMagpieUltra](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_argilla_magpie) and [RoHelpSteer2](https://huggingface.co/datasets/OpenLLM-Ro/ro_dpo_helpsteer2))
|
| 39 |
+
- 28-11-2025: we release augmented pretraining data and quality classifier
|
| 40 |
+
- 05-06-2026: we release RoVLMs together with training and evaluation data
|
| 41 |
+
-
|
| 42 |
We encourage the community to engage in discussions (to provide feedback, ask questions, or make improvement suggestions) in Hugging Face or GitHub.
|
| 43 |
|
| 44 |
We will also organize physical meetings (announced in advance) to brainstorm ideas, roadmap, and other technical aspects.
|