MarinDNA exp586 archive
BF16 endpoint exports from experiment 586:
| Directory | Initialization and LR | DNA training tokens | Checkpoint | Standalone model |
|---|---|---|---|---|
pretrained-lrm0p5-seed0/ |
Language-pretrained, 0.5Γ | 216,158,699,520 | step-412290 |
β |
pretrained-lrm1-seed0/ |
Language-pretrained, 1Γ | 216,158,699,520 | step-412290 |
216B |
pretrained-lrm2-seed0/ |
Language-pretrained, 2Γ | 216,158,699,520 | step-412290 |
β |
scratch-lrm1-seed0/ |
Random, 1Γ | 216,158,699,520 | step-412290 |
β |
pretrained-lrm1-seed0-1t/ |
Language-pretrained, 1Γ | 1,000,000,192,512 | step-1907349 |
1T |
The 216B-token endpoints have trained for 10 DNA epochs; the 1T-token endpoint has trained for approximately 46.3. The 1T export is an unchanged copy of the standalone model; per-model receipts preserve the source checkpoints and file identities.
Inference Providers NEW
This model isn't deployed by any Inference Provider. π Ask for provider support