Please create 4 bit dwq quant mlx version
#1
by
Narutoouz
- opened
Thank you
I don't know if someone will create this. For now you can use the 4-bit quant I created at https://huggingface.co/mlx-community/MiniMax-M2.1-4bit
@kernelpool has created the quant you requested. See https://huggingface.co/catalystsec/MiniMax-M2.1-4bit-DWQ
bibproj
changed discussion status to
closed