🔄 In a Training Loop

Banaxi PRO

Banaxi-Tech

39 32

Banaxi-Tech

AI & ML interests

SLMs, training from scratch, LoRA, TTS, Ternary models

Recent Activity

updated a Space about 4 hours ago

Banaxi-Tech/Open_SLM_Leaderboard

updated a model about 4 hours ago

Banaxi-Tech/test-medium

repliedto appvoid's post about 4 hours ago

If you make cool smol 🤖🤏 models (below 0.5b parameters), leave a reply and I will follow you! I'm serious, you don't need to follow me at all just share something through the replies and I (and potentially more people) will follow you (if your models are decent ofc).

View all activity

Organizations

Posts 12

Post

👀 BananaMind 2 Medium is coming soon, in about 2 days.
Release Status BananaMind/BananaMind-2-Medium-Status

Post

2429

Introducing BananaMind 2 Nano

BananaMind 2 Nano is the smallest member of the BananaMind 2.0 family — a 10M-parameter language model that shows how much you can squeeze out of a tiny footprint. It uses the family's digit-isolated tokenizer, so it keeps solid arithmetic despite its size, and it's small enough to run just about anywhere.

Trained on 30B tokens in about a day on a single RTX 5070 Ti (16GB), 4096-token context.

Benchmarks:

Average 35.77
ARC Easy 36.20
PIQA 55.98
ARC Challenge 23.38
HellaSwag 27.50

That 35.77 average edges out Pythia-31M (~34.79) at roughly a third the parameters.

Released under Apache 2.0 on Hugging Face: BananaMind/BananaMind-2-Nano — weights, tokenizer, and config included.