Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,004

Base only

Active filters: imatrix

duyntnet/Hexoteric-7B-imatrix-GGUF

Text Generation • 7B • Updated Aug 9, 2024 • 667

ngxson/Meta-Llama-3.1-8B-Instruct-Q8_0

8B • Updated Aug 9, 2024 • 6

mradermacher/ChatWaifu_v1.2.1-i1-GGUF

12B • Updated Sep 8, 2024 • 12 • 2

mradermacher/medibuddy-llm-9B-i1-GGUF

8B • Updated Aug 9, 2024 • 73

mradermacher/nemolita-21b-i1-GGUF

20B • Updated Aug 9, 2024 • 226

Nexesenex/Google_Gemma-2-9b-it_iMat_Custom_Quant_Stategies-GGUF

9B • Updated Aug 20, 2024 • 147

mradermacher/AlphaMonarch-7B-i1-GGUF

7B • Updated Aug 10, 2024 • 547

mradermacher/NemoDori-v0.1-12B-MS-i1-GGUF

12B • Updated Aug 10, 2024 • 115 • 1

mradermacher/L3.1-Siithamo-v0.1-8B-i1-GGUF

8B • Updated Aug 10, 2024 • 395 • 1

mradermacher/Viviana_V2-i1-GGUF

7B • Updated Aug 10, 2024 • 148

mradermacher/NemoDori-v0.2-12B-MN-BT-i1-GGUF

12B • Updated Aug 10, 2024 • 295 • 1

mradermacher/Nemo_instruct-Enh-FT-V3-i1-GGUF

12B • Updated Aug 10, 2024 • 4

mradermacher/EduMixtral-4x7B-i1-GGUF

24B • Updated Aug 10, 2024 • 93

bartowski/Theia-21B-v1-GGUF

Text Generation • 20B • Updated Aug 10, 2024 • 1.37k • 2

mradermacher/Theia-21B-v1-i1-GGUF

20B • Updated Aug 10, 2024 • 303 • 3

duyntnet/gemma-2-2b-it-imatrix-GGUF

Text Generation • 3B • Updated Aug 10, 2024 • 714

mradermacher/L3.1-Siithamo-v0.2-8B-i1-GGUF

8B • Updated Dec 16, 2024 • 35 • 1

mradermacher/Llama-3-8B-Stroganoff-3.0-i1-GGUF

8B • Updated Aug 11, 2024 • 7 • 2

ar08/Llama-2-7b-chat-hf-IQ3_M-GGUF

Text Generation • 7B • Updated Aug 11, 2024 • 20

mradermacher/Danish-Mistral-Nemo-Base-i1-GGUF

12B • Updated Aug 11, 2024 • 332 • 1

jsfs11/L3-SaoMerge-Della-v1-Q5_K_M-GGUF

8B • Updated Aug 11, 2024 • 4

mradermacher/DoubleBagel-57B-v1.0-i1-GGUF

57B • Updated Aug 11, 2024 • 30

Cran-May/Infinity-Instruct-3M-0625-Yi-1.5-9B-Q4_K_M-GGUF

9B • Updated Aug 11, 2024 • 10

n3shelter/Peach-9B-8k-Roleplay-IQ4_XS-GGUF

Text Generation • 9B • Updated Aug 11, 2024 • 59 • 1

mradermacher/2B_or_not_2B-i1-GGUF

3B • Updated Jan 26, 2025 • 1.08k • 1

wiktorwojcik112/Qwen2-1.5b-GGUF

0.5B • Updated Aug 11, 2024 • 7

tHottie/NeuralDaredevil-8B-abliterated-Q4_K_M-GGUF

8B • Updated Aug 11, 2024 • 30 • 1

mradermacher/Starlight-V3-12B-i1-GGUF

12B • Updated Aug 11, 2024 • 368 • 1

FredZhang7/claudegpt-code-logic-debugger-v0.1

Text Generation • 33B • Updated Sep 23, 2024 • 214 • 8

mradermacher/MN-LooseCannon-12B-v1-i1-GGUF

12B • Updated Aug 12, 2024 • 314 • 2