Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

119

Base only

Active filters: 7-bit

SicariusSicariiStuff/Dusk_Rainbow-EXL2-7.0-bpw

Text Generation • Updated Jul 25, 2025 • 8

SicariusSicariiStuff/KoboldAI_LLaMA2-13B-Psyfighter2-EXL2-7.0bpw

Updated Aug 20, 2024 • 3

SicariusSicariiStuff/PygmalionAI_pygmalion-7b-EXL2-7.0bpw

Text Generation • Updated Aug 20, 2024 • 11

SicariusSicariiStuff/Phi-3.5-mini-instruct_Uncensored-EXL2-7.0bpw

Text Generation • Updated Jul 25, 2025 • 7

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_7.0bpw_h8

Text Generation • Updated Aug 22, 2024 • 6

bigstorm/Hermes-3-Llama-3.1-70B-7.0bpw-8hb-exl2

Updated Aug 26, 2024 • 6

SicariusSicariiStuff/2B-ad-EXL2-7.0bpw

Text Generation • Updated Jul 25, 2025 • 9

bigstorm/dolphin-2.9.4-llama3.1-8b-7.0bpw-8hb-exl2

Updated Aug 28, 2024 • 4

BigHuggyD/c4ai-command-r-plus-08-2024_exl2_7.0bpw_h8

Text Generation • Updated Aug 31, 2024 • 8

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_7.0bpw_h8

Text Generation • Updated Sep 7, 2024 • 8 • 1

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-7.0bpw

Updated Sep 11, 2024 • 4

DrNicefellow/Qwen2.5-32B-Instruct-7.0bpw-exl2

Updated Sep 19, 2024 • 4

DrNicefellow/Qwen2.5-7B-Instruct-7.0bpw-exl2

Updated Sep 20, 2024 • 4

DrNicefellow/Qwen2.5-14B-Instruct-7.0bpw-exl2

Updated Sep 20, 2024 • 5

bigstorm/Qwen2.5-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Sep 20, 2024 • 9

DrNicefellow/Qwen2.5-Coder-7B-Instruct-7.0bpw-exl2

Updated Sep 21, 2024 • 6

DrNicefellow/Qwen2.5-Math-7B-Instruct-7.0bpw-exl2

Updated Sep 21, 2024 • 7

BigHuggyD/gghfez_SmartMaid-123b_exl2_7.0bpw_h8

Updated Sep 28, 2024 • 5

SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-7.0bpw

Text Generation • Updated Jul 26, 2025 • 7

BigHuggyD/TheDrummer_Behemoth-123B-v1_exl2_7.0bpw_h8

Updated Oct 11, 2024 • 3

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-7.0-bpw

Text Generation • Updated Jul 26, 2025 • 7

schnapper79/lumikabra-behemoth-123b-exl2-7.0bpw

Text Generation • Updated Oct 14, 2024 • 7

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-7.0bpw-8hb-exl2

Text Generation • Updated Oct 16, 2024 • 10 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v1.1_exl2_7.0bpw_h6

Updated Oct 28, 2024 • 3

llmixer/Mistral-Large-Instruct-2407-7.0bpw-h8-exl2

Updated Nov 12, 2024 • 9

DrNicefellow/Qwen2.5-Coder-32B-Instruct-7.0bpw-exl2

Updated Nov 12, 2024 • 5

DrNicefellow/Qwen2.5-Coder-14B-Instruct-7.0bpw-exl2

Updated Nov 12, 2024 • 3

BigHuggyD/Mistral-Large-Instruct-2411_exl2_7.0bpw_h8

Updated Nov 20, 2024 • 5

BigHuggyD/MarsupialAI_Monstral-123B_exl2_7.0bpw_h8

Text Generation • Updated Nov 23, 2024 • 7

BigHuggyD/TheDrummer_Behemoth-123B-v2.2_exl2_7.0bpw_h8

Updated Nov 25, 2024 • 3