Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

876

Full-text search

Active filters: language

bartowski/granite-embedding-107m-multilingual-GGUF

Text Generation • 0.1B • Updated Dec 23, 2024 • 12.2k • 3

lmstudio-community/granite-embedding-107m-multilingual-GGUF

Text Generation • 0.1B • Updated Dec 23, 2024 • 285 • 2

bartowski/granite-embedding-278m-multilingual-GGUF

Text Generation • 0.3B • Updated Dec 23, 2024 • 660 • 6

lmstudio-community/granite-embedding-278m-multilingual-GGUF

Text Generation • 0.3B • Updated Dec 23, 2024 • 189 • 2

jncraton/granite-embedding-30m-english-ct2-int8

Sentence Similarity • Updated Dec 18, 2024 • 99

jncraton/granite-embedding-125m-english-ct2-int8

Sentence Similarity • Updated Dec 18, 2024 • 1

jncraton/granite-embedding-107m-multilingual-ct2-int8

Sentence Similarity • Updated Dec 18, 2024 • 2

ticlazau/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Dec 19, 2024 • 11

QuantFactory/granite-3.1-2b-base-GGUF

3B • Updated Dec 19, 2024 • 14 • 3

QuantFactory/granite-3.1-2b-instruct-GGUF

Text Generation • 3B • Updated Dec 19, 2024 • 53 • 4

QuantFactory/granite-3.1-3b-a800m-base-GGUF

Text Generation • 3B • Updated Dec 19, 2024 • 174 • 3

QuantFactory/granite-3.1-3b-a800m-instruct-GGUF

Text Generation • 3B • Updated Dec 19, 2024 • 73 • 7

QuantFactory/granite-3.1-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Dec 19, 2024 • 26 • 4

QuantFactory/granite-3.1-1b-a400m-base-GGUF

Text Generation • 1B • Updated Dec 19, 2024 • 38 • 4

QuantFactory/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Dec 19, 2024 • 83 • 7

mradermacher/granite-3.1-1b-a400m-base-GGUF

1B • Updated Dec 21, 2024 • 45

mradermacher/granite-3.1-1b-a400m-instruct-GGUF

1B • Updated Dec 21, 2024 • 84

mradermacher/granite-3.1-2b-base-GGUF

3B • Updated Dec 21, 2024 • 39

mradermacher/granite-3.1-2b-instruct-GGUF

3B • Updated Dec 20, 2024 • 65

mradermacher/granite-3.1-8b-base-GGUF

8B • Updated Dec 20, 2024 • 64

mradermacher/granite-3.1-8b-instruct-GGUF

8B • Updated Dec 20, 2024 • 108 • 1

mradermacher/granite-3.1-1b-a400m-base-i1-GGUF

1B • Updated Dec 21, 2024 • 47

mradermacher/granite-3.1-8b-instruct-i1-GGUF

8B • Updated Feb 13, 2025 • 196 • 2

mradermacher/granite-3.1-1b-a400m-instruct-i1-GGUF

1B • Updated Dec 21, 2024 • 92 • 2

mradermacher/granite-3.1-2b-instruct-i1-GGUF

3B • Updated Dec 20, 2024 • 394

mradermacher/granite-3.1-2b-base-i1-GGUF

3B • Updated Dec 21, 2024 • 156

QuantFactory/granite-3.1-8b-base-GGUF

8B • Updated Dec 20, 2024 • 41 • 3

mradermacher/granite-3.1-8b-base-i1-GGUF

8B • Updated Dec 20, 2024 • 70

skarmani/granite-3.1-2b-instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Dec 21, 2024 • 7

huihui-ai/granite-3.1-2b-instruct-abliterated

Text Generation • 3B • Updated Dec 21, 2024 • 6 • 3