Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

arxiv: 2502.14837

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

17

Base only

Active filters: 2502.14837

OpenMOSS-Team/Llama-2-7B-MLA-d_kv_16

Text Generation • 6B • Updated Mar 13, 2025 • 2 • 1

OpenMOSS-Team/Llama-2-7B-MLA-d_kv_32

Text Generation • 6B • Updated Mar 13, 2025 • 5 • 1

OpenMOSS-Team/Llama-2-7B-MLA-d_kv_64

Text Generation • 7B • Updated Mar 13, 2025 • 3 • 1

OpenMOSS-Team/Llama-2-7B-MHA-d_kv_256

Text Generation • 7B • Updated Mar 13, 2025 • 5 • • 3

OpenMOSS-Team/SmolLM-135M-MLA-d_kv_8

Text Generation • 0.1B • Updated Mar 13, 2025 • 3 • 1

OpenMOSS-Team/SmolLM-135M-MLA-d_kv_16

Text Generation • Updated Mar 13, 2025

OpenMOSS-Team/SmolLM-135M-MLA-d_kv_32

Text Generation • 0.1B • Updated Mar 13, 2025 • 3

OpenMOSS-Team/SmolLM-135M-GQA-d_kv_128

Text Generation • 0.1B • Updated Mar 13, 2025 • 6

OpenMOSS-Team/SmolLM-360M-MLA-d_kv_8

Text Generation • 0.3B • Updated Mar 13, 2025 • 3

OpenMOSS-Team/SmolLM-360M-MLA-d_kv_16

Text Generation • 0.3B • Updated Mar 13, 2025 • 3

OpenMOSS-Team/SmolLM-360M-MLA-d_kv_32

Text Generation • 0.4B • Updated Mar 13, 2025 • 5

OpenMOSS-Team/SmolLM-360M-GQA-d_kv_128

Text Generation • 0.4B • Updated Mar 13, 2025 • 2

OpenMOSS-Team/SmolLM-1B7-MLA-d_kv_8

Text Generation • 2B • Updated Mar 13, 2025 • 3

OpenMOSS-Team/SmolLM-1B7-MLA-d_kv_16

Text Generation • 2B • Updated Mar 13, 2025 • 4

OpenMOSS-Team/SmolLM-1B7-MLA-d_kv_32

Text Generation • 2B • Updated Mar 13, 2025 • 3

OpenMOSS-Team/SmolLM-1B7-MHA-d_kv_128

Text Generation • 2B • Updated Mar 13, 2025 • 2

OpenMOSS-Team/SmolLM-135M-MLA-d_kv_8-refactor

Text Generation • 0.1B • Updated Jun 23, 2025 • 2 • 1