Qwen/Qwen3-4B-Instruct-2507
Text Generation • Updated
• 3.74M • • 757
Models for local deployment
-
-
unsloth/Qwen3-4B-Instruct-2507-GGUF
4B • Updated • 83.5k • 162 -
HuggingFaceTB/SmolLM3-3B
Text Generation • Updated • 103k • 903 -
unsloth/SmolLM3-3B-GGUF
3B • Updated • 1.71k • 19
Qwen/Qwen3-Embedding-4B-GGUF
4B • Updated • 11.2k • 90Note ./build/bin/llama-server -hf Qwen/Qwen3-Embedding-4B-GGUF:Q6_K --port 8080 --pooling last --verbose-prompt --parallel 4 --batch-size 8 --embedding --ctx-size 8000 --cache-type-k q4_0 --gpu-layers 36
-
Qwen/Qwen3-Embedding-0.6B
Feature Extraction • 0.6B • Updated • 4.31M • • 893 -
google/gemma-3-270m
Text Generation • Updated • 143k • 991 -
ByteDance/Ouro-1.4B
Text Generation • Updated • 15.8k • 76 -
unsloth/Qwen3.5-27B-GGUF
Image-Text-to-Text • 27B • Updated • 218k • 186