FP8 dynamic quantized model with compressored tensors. per-channel weight and per-token activation.
- Downloads last month
- 1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
FP8 dynamic quantized model with compressored tensors. per-channel weight and per-token activation.