Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,844

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 11 days ago • 665k • • 1.09k

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 12 days ago • 2.34M • 681

FINAL-Bench/POCKET-35B-GGUF

Text Generation • 35B • Updated 3 days ago • 8.23k • 57

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated May 26 • 626k • 1.02k

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated 14 days ago • 40.9k • 189

FINAL-Bench/POCKET-26B-GGUF

Text Generation • 25B • Updated 3 days ago • 1.08k • 36

FINAL-Bench/POCKET-EN-GGUF

Text Generation • 23B • Updated 3 days ago • 1.69k • 33

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated 14 days ago • 32.7k • 154

Cactus-Compute/needle

30.4M • Updated 16 days ago • 1.33k • 313

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 32.1k • 894

runanywhere/silero-vad-v5

Voice Activity Detection • Updated Feb 13 • 7

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 108k • 129

FINAL-Bench/POCKET-KR-GGUF

Text Generation • 23B • Updated 3 days ago • 1.29k • 26

FINAL-Bench/POCKET-KR-MLX

Text Generation • 15B • Updated 3 days ago • 525 • 26

FINAL-Bench/POCKET-Image-Zimage

Text-to-Image • 3B • Updated 1 day ago • 11 • 26

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 6.97k • 40

litert-community/MedGemma-1.5-4B-IT

Text Generation • Updated 18 days ago • 542 • 8

mihuai/turkish-stt

Automatic Speech Recognition • Updated 7 days ago • 4

prism-ml/Bonsai-8B-mlx-1bit

Text Generation • 0.4B • Updated Apr 18 • 22.4k • 231

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 32.9k • 83

prism-ml/Ternary-Bonsai-8B-mlx-2bit

Text Generation • 0.6B • Updated Apr 18 • 22.7k • 120

PeppX/gemma-4-e2b-uncensored-litertlm

Updated 12 days ago • 2.7k • 13

openbmb/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated May 25 • 97.6k • 215

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

Text Generation • 12B • Updated Jun 23 • 430 • 4

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 57.5k • 759

DuoNeural/Gemma-4-Abliterated-LiteRT

Text Generation • Updated May 1 • 10

openbmb/MiniCPM5-1B-SFT

Text Generation • 1B • Updated May 25 • 12.8k • 38

prism-ml/bonsai-image-ternary-4B-mlx-2bit

Text-to-Image • Updated Jun 1 • 2.93k • 87

Reza2kn/Shenava-Koochik-v1.0

Automatic Speech Recognition • Updated Jun 26 • 432 • 13

sujithatz/ggml-whisper-medium-ml

Updated Oct 3, 2025 • 2