Inference Providers
Active filters: 5-bit
MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF
Text Generation
• 8B • Updated • 142k
• 59
MaziyarPanahi/Llama-3.2-3B-Instruct-uncensored-GGUF
Text Generation
• 4B • Updated • 780
• 4
roleplaiapp/Qwen2.5-Coder-14B-Instruct-Uncensored-Q5_K_M-GGUF
Text Generation
• 15B • Updated • 549
• 2
lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-5bit
Text Generation
• 31B • Updated • 176k
• 8
mlx-community/Qwen3-4B-Instruct-2507-5bit
Text Generation
• Updated • 15
• 2
mlx-community/Hermes-4-70B-5bit
Text Generation
• 71B • Updated • 42
• 2
mlx-community/NVIDIA-Nemotron-3-Super-120B-A12B-5bit
Text Generation
• 121B • Updated • 2.9k
• 3
Brooooooklyn/Qwen3.6-35B-A3B-UD-Q5_K_XL-mlx
Text Generation
• 8B • Updated • 628
• 2
AntimatterAI/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-MLX-5bit
Text Generation
• 35B • Updated • 957
• 2
deepsweet/Qwen3.6-35B-A3B-MLX-VL-oQ5
Text Generation
• 7B • Updated • 375
• 1
tevino/Qwen3.6-35B-A3B-oQ5-mtp
7B • Updated • 230
• 1
zecanard/Qwopus3.6-27B-v2-MLX-5bit-int5-affine
Image-Text-to-Text
• 6B • Updated • 129
• 1
MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF
Text Generation
• 12B • Updated • 142k
• 53
LoneStriker/Yi-6B-200K-5.0bpw-h6-exl2
Text Generation
• Updated • 7
Text Generation
• 3B • Updated • 226
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 1.22k
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 875
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 922
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 118
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 182
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 175
• 2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 167
• 2
MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 155
• 1
MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 131
• 1
MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 84
• 1
MaziyarPanahi/Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 126
• 1
MaziyarPanahi/Commonsense-QA-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 163
• 1
MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 531
• 6
MaziyarPanahi/finetuned-mistral-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 134
MaziyarPanahi/Mistral-7B-Instruct-guidance-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 94