Meta-Llama-3.1-Quantized Collection of quantized Llama 3.1 models (8B & 70B versions for now), using bitsandbites. fsaudm/Meta-Llama-3.1-8B-Instruct-NF4 Text Generation • 8B • Updated Sep 27, 2024 • 21 fsaudm/Meta-Llama-3.1-70B-Instruct-NF4 Text Generation • 73B • Updated Oct 5, 2024 • 21 fsaudm/Meta-Llama-3.1-8B-Instruct-INT8 Text Generation • 8B • Updated Aug 21, 2024 • 5 fsaudm/Meta-Llama-3.1-70B-Instruct-INT8 Text Generation • 71B • Updated Aug 21, 2024 • 34
Meta-Llama-3.1-Quantized Collection of quantized Llama 3.1 models (8B & 70B versions for now), using bitsandbites. fsaudm/Meta-Llama-3.1-8B-Instruct-NF4 Text Generation • 8B • Updated Sep 27, 2024 • 21 fsaudm/Meta-Llama-3.1-70B-Instruct-NF4 Text Generation • 73B • Updated Oct 5, 2024 • 21 fsaudm/Meta-Llama-3.1-8B-Instruct-INT8 Text Generation • 8B • Updated Aug 21, 2024 • 5 fsaudm/Meta-Llama-3.1-70B-Instruct-INT8 Text Generation • 71B • Updated Aug 21, 2024 • 34