usik-luke commited on
Commit
e8b7dc3
·
1 Parent(s): c49224e

Model card: rename Trida2.0-4B to Zoro (#1)

Browse files

- Model card: rename Trida2.0-4B to Zoro (d51eec766e9040014207e7f6980b4bcb44ca63cb)

Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -8,11 +8,11 @@ tags:
8
  - qwen3.5
9
  ---
10
 
11
- # trillionlabs/Trida2.0-4B
12
 
13
  *English | [한국어](./README_ko.md)*
14
 
15
- **Trida2.0-4B** is a two-stream **block-diffusion** language model (research checkpoint). It is produced
16
  by continued SFT with the **full-mask recipe** — 100% of each block masked (single view, no
17
  complementary mask) at block size **bd=8**, fresh optimizer, LR 5e-5, ~2k steps — starting from the
18
  base SFT checkpoint (v6, step_18000).
@@ -36,7 +36,7 @@ untrained). Runs on the HybridDiffusion SGLang fork. `mask_id = 248077`, vocab 2
36
 
37
  Concurrency 1, threshold 0.9, reasoning on. *A vanilla Qwen3.5-4B baseline is being added.*
38
 
39
- | benchmark | Trida2.0 · self-spec | Trida2.0 · AR |
40
  |---|---|---|
41
  | GSM8K | **84.2** | **89.3** |
42
  | MMLU-Pro | 63.0 | — |
@@ -49,15 +49,15 @@ Concurrency 1, threshold 0.9, reasoning on. *A vanilla Qwen3.5-4B baseline is be
49
  ## Serving speed & parallel commit (concurrency 1)
50
 
51
  Block-diffusion self-spec commits **multiple tokens per forward pass** at verify-guaranteed AR
52
- quality. Trida2.0-4B's full-mask training makes it a better drafter, so it accepts more per step and
53
  runs faster than the base.
54
 
55
  | model · decoding | tok/s (per-request) | tokens / forward |
56
  |---|---|---|
57
- | **Trida2.0 · self-spec** | **243** | **2.59** |
58
- | Trida2.0 · AR | 216 | 1.00 |
59
 
60
- Per-benchmark commit rate (Trida2.0 self-spec, tokens/forward): **GSM8K 3.10, BFCL 2.33, MMLU-Pro 2.33**.
61
 
62
 
63
  ## License
 
8
  - qwen3.5
9
  ---
10
 
11
+ # trillionlabs/Zoro
12
 
13
  *English | [한국어](./README_ko.md)*
14
 
15
+ **Zoro** is a two-stream **block-diffusion** language model (research checkpoint). It is produced
16
  by continued SFT with the **full-mask recipe** — 100% of each block masked (single view, no
17
  complementary mask) at block size **bd=8**, fresh optimizer, LR 5e-5, ~2k steps — starting from the
18
  base SFT checkpoint (v6, step_18000).
 
36
 
37
  Concurrency 1, threshold 0.9, reasoning on. *A vanilla Qwen3.5-4B baseline is being added.*
38
 
39
+ | benchmark | Zoro · self-spec | Zoro · AR |
40
  |---|---|---|
41
  | GSM8K | **84.2** | **89.3** |
42
  | MMLU-Pro | 63.0 | — |
 
49
  ## Serving speed & parallel commit (concurrency 1)
50
 
51
  Block-diffusion self-spec commits **multiple tokens per forward pass** at verify-guaranteed AR
52
+ quality. Zoro's full-mask training makes it a better drafter, so it accepts more per step and
53
  runs faster than the base.
54
 
55
  | model · decoding | tok/s (per-request) | tokens / forward |
56
  |---|---|---|
57
+ | **Zoro · self-spec** | **243** | **2.59** |
58
+ | Zoro · AR | 216 | 1.00 |
59
 
60
+ Per-benchmark commit rate (Zoro self-spec, tokens/forward): **GSM8K 3.10, BFCL 2.33, MMLU-Pro 2.33**.
61
 
62
 
63
  ## License