antirez/deepseek-v4-gguf · code

code

#13

by erichartford - opened Jun 21

Jun 21

Can you please share the code you used to quantize the model?
this will be interesting for porting ds4 to other models.

Jun 22

https://github.com/antirez/ds4/tree/main/gguf-tools#generate-q2-and-q4-ggufs

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment