16 GB

1 contributor

History: 116 commits

geoffmunn

Update Q4_Quantization_Comparison.md

7cbc2c7 verified 2 days ago

Qwen3-1.7B-f16-Q2_K
f16 path changed about 1 month ago
Qwen3-1.7B-f16-Q3_K_M
f16 path changed about 1 month ago
Qwen3-1.7B-f16-Q3_K_S
f16 path changed about 1 month ago
Qwen3-1.7B-f16-Q4_K_M
f16 path changed about 1 month ago
Qwen3-1.7B-f16-Q4_K_S
f16 path changed about 1 month ago
Qwen3-1.7B-f16-Q5_K_M
f16 path changed about 1 month ago
Qwen3-1.7B-f16-Q5_K_S
f16 path changed about 1 month ago
Qwen3-1.7B-f16-Q6_K
f16 path changed about 1 month ago
Qwen3-1.7B-f16-Q8_0
Rename Qwen3-1.7B-Q8_0/README.md to Qwen3-1.7B-f16-Q8_0/README.md about 1 month ago
.gitattributes

3.46 kB

Upload Q4_K_HIFI + imatrix quantized model 3 days ago
MODELFILE

563 Bytes

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload 4 months ago
Q3_Quantization_Comparison.md

5.21 kB

Upload 3 files 18 days ago
Q4_Quantization_Comparison.md

9.79 kB

Update Q4_Quantization_Comparison.md 2 days ago
Qwen3-1.7B-f16-imatrix-4697.gguf

2.09 MB
xet

Upload imatrix gguf 3 days ago
Qwen3-1.7B-f16-imatrix:Q4_K_HIFI.gguf

1.34 GB
xet

Upload Q4_K_HIFI + imatrix quantized model 3 days ago
Qwen3-1.7B-f16-imatrix:Q4_K_M.gguf

1.28 GB
xet

Upload Q4_K_M + imatrix quantized model 3 days ago
Qwen3-1.7B-f16-imatrix:Q4_K_S.gguf

1.24 GB
xet

Upload Q4_K_S + imatrix quantized model 3 days ago
Qwen3-1.7B-f16:Q2_K.gguf

880 MB
xet

Rename Qwen3-1.7B-f16-Q2_K.gguf to Qwen3-1.7B-f16:Q2_K.gguf about 1 month ago
Qwen3-1.7B-f16:Q3_HIFI.gguf

1.05 GB
xet

Rename Qwen3-1.7B-f16-Q3_HIFI.gguf to Qwen3-1.7B-f16:Q3_HIFI.gguf 6 days ago
Qwen3-1.7B-f16:Q3_K_M.gguf

1.07 GB
xet

Rename Qwen3-1.7B-f16-Q3_K_M.gguf to Qwen3-1.7B-f16:Q3_K_M.gguf about 1 month ago
Qwen3-1.7B-f16:Q3_K_S.gguf

1 GB
xet

Rename Qwen3-1.7B-f16-Q3_K_S.gguf to Qwen3-1.7B-f16:Q3_K_S.gguf about 1 month ago
Qwen3-1.7B-f16:Q4_K_HIFI.gguf

1.34 GB
xet

Upload Q4_K_HIFI quantized model 3 days ago
Qwen3-1.7B-f16:Q5_K_M.gguf

1.47 GB
xet

Rename Qwen3-1.7B-f16-Q5_K_M.gguf to Qwen3-1.7B-f16:Q5_K_M.gguf about 1 month ago
Qwen3-1.7B-f16:Q5_K_S.gguf

1.44 GB
xet

Rename Qwen3-1.7B-f16-Q5_K_S.gguf to Qwen3-1.7B-f16:Q5_K_S.gguf about 1 month ago
Qwen3-1.7B-f16:Q6_K.gguf

1.67 GB
xet

Rename Qwen3-1.7B-f16-Q6_K.gguf to Qwen3-1.7B-f16:Q6_K.gguf about 1 month ago
Qwen3-1.7B-f16:Q8_0.gguf

2.17 GB
xet

Rename Qwen3-1.7B-f16-Q8_0.gguf to Qwen3-1.7B-f16:Q8_0.gguf about 1 month ago
Qwen3-1.7b-f16-analysis.md

83.6 kB

f16 path changed about 1 month ago
README.md

7.64 kB

Tags updated 8 days ago
mixed-imatrix-dataset.txt

10.3 MB

imatrix dataset 3 days ago