Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

15

Base only

Active filters: awq_marlin

QuantTrio/GLM-4.5-Air-AWQ-FP16Mix

Text Generation • 24B • Updated Sep 5, 2025 • 9.1k • 14

QuantTrio/GLM-4.5-AWQ

Text Generation • 53B • Updated Sep 5, 2025 • 68 • 9

QuantTrio/GLM-4.5V-AWQ

Image-Text-to-Text • 17B • Updated Aug 25, 2025 • 414 • 19

QuantTrio/GLM-4.6-AWQ

Text Generation • 50B • Updated Oct 2, 2025 • 195 • 5

mozarcik/Llama-PLLuM-70B-base-2508-awq

Text Generation • 11B • Updated May 23 • 14

mozarcik/Llama-PLLuM-70B-base-2412-awq

Text Generation • 11B • Updated May 23 • 9

mozarcik/Llama-PLLuM-70B-chat-2508-awq

Text Generation • 11B • Updated May 23 • 9

mozarcik/Llama-PLLuM-70B-chat-2412-awq

Text Generation • 11B • Updated May 23 • 12

mozarcik/Llama-PLLuM-70B-instruct-2412-awq

Text Generation • 11B • Updated May 23 • 13

mozarcik/Llama-PLLuM-70B-instruct-2508-awq

Text Generation • 11B • Updated May 23 • 11

mozarcik/Llama-PLLuM-70B-chat-2512-awq

Text Generation • 11B • Updated May 23 • 20

mozarcik/Llama-PLLuM-70B-instruct-2512-awq

Text Generation • 11B • Updated May 23 • 23

mozarcik/PLLuM-12B-chat-2512-awq

Text Generation • 3B • Updated May 26 • 17

mozarcik/Llama-PLLuM-8B-chat-2512-awq

Text Generation • 2B • Updated May 26 • 8

Shankara-A-S/g4e4-it-r2-awq-smoke-v0

Image-Text-to-Text • 5B • Updated Jun 12