Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

26

Base only

Active filters: rtx-4090

Sumitc13/flash-attn-windows-wheels

Updated May 7 • 3

pyros-vault/Ornith-1.5-35B-A3B-BigBang-MTP-NInfer

Image-Text-to-Text • Updated 10 days ago • 70 • 1

Alissonerdx/Dia1.6-pt_BR-v1

Text-to-Audio • Updated May 27, 2025 • 29 • 28

ykarout/Qwen3.5-27B-exl3-3.0bpw

Image-Text-to-Text • 7B • Updated Mar 20 • 23 • 2

adityawakharkar/AstraGPTCoder-7B

Text Generation • 8B • Updated Jun 28 • 18 • • 3

mradermacher/AstraGPTCoder-7B-GGUF

8B • Updated Jun 29 • 202 • 1

mradermacher/AstraGPTCoder-7B-i1-GGUF

8B • Updated Jun 29 • 837 • 1

tjarvis91/qovaryx-50m-scratch-base

Text Generation • Updated Jun 5 • 21

tjarvis91/qovaryx-350m-scratch-base

Text Generation • Updated Jun 5 • 15 • 1

tjarvis91/qovaryx-1b-scratch-base

Text Generation • Updated Jun 5 • 11

tjarvis91/qovaryx-3b-scratch-base

Text Generation • Updated Jun 5 • 13

XXXXyu/Cosmos3-Nano-Policy-DROID-Marlin-W8A16

Robotics • 2B • Updated 11 days ago • 23

XXXXyu/Cosmos3-Nano-Policy-DROID-Marlin-W4A16

Robotics • 2B • Updated 11 days ago • 15 • 1

XXXXyu/Cosmos3-Nano-Policy-DROID-Marlin-W4A16-AttnW8

Robotics • 2B • Updated 11 days ago • 10

XXXXyu/Cosmos3-Nano-Policy-DROID-Marlin-W4A16-GenW8

Robotics • 2B • Updated 11 days ago • 13

SinclairSchneider/DeepSeek-V4-Flash-W4A16-FP8-MTP-Ada

Text Generation • 51B • Updated Jul 23 • 34 • 1

XXXXyu/Cosmos3-Edge-Policy-DROID-Marlin-W4A16

Robotics • 0.6B • Updated 11 days ago • 18

XXXXyu/Cosmos3-Edge-Policy-DROID-Marlin-W8A16

Robotics • 0.6B • Updated 11 days ago • 23 • 1

XXXXyu/Cosmos3-Edge-Policy-DROID-Marlin-W4A16-AttnW8

Robotics • 0.6B • Updated 11 days ago • 13

XXXXyu/Cosmos3-Edge-Policy-DROID-Marlin-W4A16-GenW8

Robotics • 0.6B • Updated 11 days ago • 16

Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV

Text Generation • 16B • Updated Jul 30 • 105 • 1

pyros-vault/Qwen3.8-27B-Uncensored-NInfer

Image-Text-to-Text • Updated 10 days ago • 1.55k • 1

pyros-vault/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NInfer

Image-Text-to-Text • Updated 10 days ago • 734 • 1

XXXXyu/Cosmos3-Nano-Policy-DROID-GenW8A8

Robotics • 2B • Updated 11 days ago • 19

XXXXyu/Cosmos3-Edge-Policy-DROID-GenW8A8

Robotics • 0.6B • Updated 11 days ago • 17

pyros-vault/Ornith-1.5-35B-A3B-fixed-mtp-NInfer

Image-Text-to-Text • Updated 10 days ago • 661