FP8-dynamic, FP8-block, NVFP4, INT4, versions of nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B
-
inference-optimization/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8-block
Updated -
inference-optimization/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8-dynamic
32B • Updated • 8 -
inference-optimization/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4
Updated -
inference-optimization/NVIDIA-Nemotron-3-Nano-30B-A3B-quantized.w4a16
Updated