schonsense/Synesthesia
Text Generation
•
71B
•
Updated
Mark Fenlon PRO
schonsense
AI & ML interests
Testing ground repo for merging, finetuning, and LORA manipulations.
Recent Activity
updated
a model
1 day ago
schonsense/Synesthesia
published
a model
1 day ago
schonsense/Synesthesia
updated
a model
3 days ago
schonsense/IPOplectic_IMAT_GGUF
Organizations
updated
a
model
1 day ago
published
a
model
1 day ago
updated
3
models
3 days ago
published
a
model
3 days ago
updated
a
model
3 days ago
published
a
model
3 days ago
commented on
The Optimal Architecture for Small Language Models
3 days ago
Very interesting, thank you.
commented on
The Optimal Architecture for Small Language Models
4 days ago
Interesting. If you compare only the model layer parameters to their performances, are any different trends seen? Thank you for responding.
commented on
The Optimal Architecture for Small Language Models
4 days ago
Can you discuss the additional things contributing to param count that were not mentioned in your article? embedding/head size, intermediate dimensions? I'm struggling to see how a 768x4 has equivalent params to a 512x12.
published
a
model
4 days ago
updated
3
models
6 days ago
published
a
model
9 days ago
updated
3
models
9 days ago
System prompt and sampler settings
❤️
1
#1 opened 9 days ago
by
schonsense