North-ML1/Forge-1-Mini
5.19M • Updated • 64 • 1
Dan P
Datdanboi25
AI & ML interests
Axiomic Labs Founder
Mechatronics engineer, LLMs, Vision Models, Embedding Models
Recent Activity
liked a model about 1 hour ago
North-ML1/Forge-1-Mini liked a model about 4 hours ago
Quazim0t0/Byrne-Embed liked a model about 9 hours ago
MultivexAI/Aurelius-Llama-v2.5-10M-LargeOrganizations
liked a
model about 1 hour ago
liked a
model about 4 hours ago
liked a
model about 9 hours ago
Benchmarks?
1
#1 opened about 10 hours ago
by Datdanboi25
updated a
Space about 11 hours ago
reacted to AxionLab-official's post with ❤️ about 12 hours ago
Post
3005
# An Open Letter from SupraLabs.
Over the past few days, SupraLabs has been mentioned in a public discussion regarding small language models, scaling laws, and training methodology. We'd like to clarify our position.
Before anything else, we want to make one thing absolutely clear: we have great respect for Lane and the work being done at Glint Research. At no point was our intention to disrespect Lane, Glint Research, or their research. What began as a technical discussion about model scaling and training methodology unfortunately became much more personal than we ever intended. From our perspective, it was simply an exchange of technical opinions, and we sincerely hope it remains that way.
We'd also like to acknowledge that one of our own comments during the discussion was poorly worded. Referring to a benchmark as "fake" was imprecise. What we intended to criticize was the comparison methodology, not the integrity of the evaluation itself. Comparing a merged checkpoint against a single checkpoint is, in our view, not an apples-to-apples comparison.
That said, this was never the core of the discussion.
Our disagreement was not about SLERP, model merging, or whether training a small model on massive amounts of data is an interesting research direction. We support experimentation and unconventional ideas.
The actual point of disagreement was much simpler.
The statement that a 1M parameter model trained on 1 trillion tokens will become a "100M killer" is, today, a prediction, not an experimental result.
Could it happen? Perhaps.
Would it be exciting if it did? Absolutely.
But until benchmark results, reproducible evaluations, and independent validation exist, we believe such statements should be presented as hypotheses rather than established conclusions.
Research advances by testing ideas, not by assuming their outcomes.
We sincerely wish Lane and everyone at Glint Research success in their experiments.
Thank you to everyone who read it.
Over the past few days, SupraLabs has been mentioned in a public discussion regarding small language models, scaling laws, and training methodology. We'd like to clarify our position.
Before anything else, we want to make one thing absolutely clear: we have great respect for Lane and the work being done at Glint Research. At no point was our intention to disrespect Lane, Glint Research, or their research. What began as a technical discussion about model scaling and training methodology unfortunately became much more personal than we ever intended. From our perspective, it was simply an exchange of technical opinions, and we sincerely hope it remains that way.
We'd also like to acknowledge that one of our own comments during the discussion was poorly worded. Referring to a benchmark as "fake" was imprecise. What we intended to criticize was the comparison methodology, not the integrity of the evaluation itself. Comparing a merged checkpoint against a single checkpoint is, in our view, not an apples-to-apples comparison.
That said, this was never the core of the discussion.
Our disagreement was not about SLERP, model merging, or whether training a small model on massive amounts of data is an interesting research direction. We support experimentation and unconventional ideas.
The actual point of disagreement was much simpler.
The statement that a 1M parameter model trained on 1 trillion tokens will become a "100M killer" is, today, a prediction, not an experimental result.
Could it happen? Perhaps.
Would it be exciting if it did? Absolutely.
But until benchmark results, reproducible evaluations, and independent validation exist, we believe such statements should be presented as hypotheses rather than established conclusions.
Research advances by testing ideas, not by assuming their outcomes.
We sincerely wish Lane and everyone at Glint Research success in their experiments.
Thank you to everyone who read it.
- 1 reply
liked a
model about 12 hours ago
liked a
model 1 day ago
updated a
Space 1 day ago
updated a
collection 1 day ago
published a
model 1 day ago
liked a
model 1 day ago
updated a
model 1 day ago
For some reason, no new model has been added
2
#18 opened 1 day ago
by 
56m
Byrne Models
7
#16 opened 3 days ago
by 
Quazim0t0
Fix GPT-S-5M wikitext
#27 opened 2 days ago
by Datdanboi25
Dumb 1.2 Preview 0618
2
#17 opened 3 days ago
by 56m
Both are nude laying on a cozy bed
3
#5 opened 4 days ago
by 
rkeshwala54
liked a
model 4 days ago
Model Submission Request: MultivexAI Plyx-15M & Supra-1.6-50M
1
#14 opened 4 days ago
by 
MultivexAI