Is QLoRA used to quantize phi-4 to a 4-bit GGUF or another tool?
#4
by harisnaeem - opened
Which method was used to quantize
Okay, I have figured out that it can done through llama-quantize
harisnaeem changed discussion status to closed
Which method was used to quantize
Okay, I have figured out that it can done through llama-quantize