MarinDNA exp586 archive

BF16 endpoint exports from experiment 586:

Directory Initialization and LR DNA training tokens Checkpoint Standalone model
pretrained-lrm0p5-seed0/ Language-pretrained, 0.5Γ— 216,158,699,520 step-412290 β€”
pretrained-lrm1-seed0/ Language-pretrained, 1Γ— 216,158,699,520 step-412290 216B
pretrained-lrm2-seed0/ Language-pretrained, 2Γ— 216,158,699,520 step-412290 β€”
scratch-lrm1-seed0/ Random, 1Γ— 216,158,699,520 step-412290 β€”
pretrained-lrm1-seed0-1t/ Language-pretrained, 1Γ— 1,000,000,192,512 step-1907349 1T

The 216B-token endpoints have trained for 10 DNA epochs; the 1T-token endpoint has trained for approximately 46.3. The 1T export is an unchanged copy of the standalone model; per-model receipts preserve the source checkpoints and file identities.

Experiment issue Β· Evaluation results

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support