Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

374

Base only

Active filters: compression

unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF

Text Generation • 23B • Updated Jan 28 • 40.1k • 225

gravitee-io/very-small-prompt-compression

Summarization • 60.5M • Updated Oct 24, 2025 • 7 • 3

huawei-csl/Qwen3-4B-PreSINQ-GGUF

Text Generation • 4B • Updated Feb 10 • 34 • 6

cyankiwi/Qwen3-Coder-Next-REAM-AWQ-4bit

Text Generation • 11B • Updated Feb 19 • 2.13k • 12

cyankiwi/MiniMax-M2.5-REAP-139B-A10B-AWQ-4bit

Text Generation • 23B • Updated Mar 9 • 486 • 14

RedHatAI/oBERT-teacher-squadv1

Updated Jul 31, 2022 • 24

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-squadv1

Updated Jul 31, 2022 • 23

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-squadv1

Updated Jul 31, 2022 • 18

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-squadv1

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-teacher-mnli

Updated Jul 31, 2022 • 10

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-mnli

Updated Jul 31, 2022 • 12

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-mnli

Updated Jul 31, 2022 • 11

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-mnli

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-teacher-qqp

Updated Jul 31, 2022 • 8

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-qqp

Updated Jul 31, 2022 • 6

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-qqp

Updated Jul 31, 2022 • 12

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-qqp

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-12-upstream-pretrained-dense

Updated Jul 31, 2022 • 6

RedHatAI/oBERT-6-upstream-pretrained-dense

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-3-upstream-pretrained-dense

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-12-upstream-pruned-unstructured-90

Updated Jul 31, 2022 • 10

RedHatAI/oBERT-12-upstream-pruned-unstructured-97

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-squadv1

Updated Jul 31, 2022 • 11

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-squadv1

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-mnli

Updated Jul 31, 2022 • 4

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-mnli

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-qqp

Updated Jul 31, 2022 • 8

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-qqp

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-12-downstream-dense-squadv1

Updated Jul 31, 2022 • 7

RedHatAI/oBERT-12-downstream-pruned-block4-80-squadv1

Updated Jul 31, 2022 • 3