Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

190

Base only

Active filters: quark

nameistoken/Qwen3.6-27B-Quark-W8A8-INT8

Image-Text-to-Text • 27B • Updated about 1 month ago • 3.86k • 6

ThingAI/Quark-270m-Base

Text Generation • 0.3B • Updated 6 days ago • 332 • 3

ThingAI/Quark-270m-Instruct

Text Generation • 0.3B • Updated 6 days ago • 160 • 2

amd/gpt-oss-20b-MoE-Quant-W-MXFP4-A-FP8-KV-FP8

11B • Updated Jan 21 • 8.09k • 2

nameistoken/Gemma-4-31B-it-Quark-W8A8-INT8

Image-Text-to-Text • 31B • Updated Apr 23 • 663 • 3

LH-Tech-AI/Quark-v2-0.5M

Text Generation • 466k • Updated May 9 • 1.21k • 7

ThingAI/Quark2Tokenizer

Text Generation • Updated 5 days ago • 1

fxmarty/llama-tiny-testing-quark-indev

1.03M • Updated Oct 3, 2024 • 4

fxmarty/llama-tiny-int4-per-group-sym

1.03M • Updated Oct 25, 2024 • 7

fxmarty/llama-tiny-w-fp8-a-fp8

1.03M • Updated Oct 22, 2024 • 20

fxmarty/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Oct 22, 2024 • 2

fxmarty/llama-tiny-w-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 2

fxmarty/llama-small-int4-per-group-sym-awq

16.7M • Updated Oct 29, 2024 • 12

fxmarty/quark-legacy-int8

1.03M • Updated Oct 10, 2024 • 5

fxmarty/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 2

fxmarty/llama-small-int4-per-group-sym-awq-old

16.7M • Updated Oct 25, 2024 • 5

amd-quark/llama-tiny-w-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 13

amd-quark/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 34

amd-quark/llama-tiny-w-fp8-a-fp8

1.03M • Updated Dec 18, 2024 • 24

amd-quark/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Dec 18, 2024 • 15

amd-quark/llama-tiny-int4-per-group-sym

1.03M • Updated Dec 18, 2024 • 12

amd-quark/llama-small-int4-per-group-sym-awq

16.7M • Updated Dec 18, 2024 • 12

amd-quark/quark-legacy-int8

1.03M • Updated Dec 18, 2024 • 5

amd/Llama-3.1-8B-Instruct-FP8-KV-Quark-test

8B • Updated Jan 7, 2025 • 24.3k

amd/Llama-3.1-8B-Instruct-w-int8-a-int8-sym-test

8B • Updated Jan 7, 2025 • 14.7k

EmbeddedLLM/Llama-3.1-8B-Instruct-w_fp8_per_channel_sym

Text Generation • 8B • Updated Jan 22, 2025 • 3

amd/DeepSeek-R1-Distill-Llama-8B-awq-asym-uint4-g128-lmhead

Text Generation • 2B • Updated Jan 30, 2025 • 4

amd-quark/llama-tiny-fp8-quark-quant-method

17.1M • Updated Feb 7, 2025 • 14.4k

aigdat/Qwen2.5-Coder-7B-quantized-ppl-14

1B • Updated Mar 11, 2025 • 1

aigdat/Qwen2-7B-Instruct_quantized_int4_bfloat16

1B • Updated Mar 13, 2025 • 2