2/3 bits OPEA/Llama-3.3-70B-Instruct-int2-sym-inc 9B • Updated Apr 30 • 44 • 1 OPEA/Llama-3.3-70B-Instruct-int3-sym-inc 66B • Updated Apr 30 • 17 OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc 9B • Updated Jul 18 • 24 • 5 OPEA/Qwen2.5-72B-Instruct-int2-sym-inc 8B • Updated Apr 30 • 22 • 1
Llama-AutoRound OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc 11B • Updated Apr 24 • 14 OPEA/Llama-3.3-70B-Instruct-int4-sym-inc 11B • Updated Apr 30 • 97 OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc 11B • Updated Apr 30 • 26 • 1 OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc 11B • Updated Apr 24 • 15 • 1
QWEN-AutoRound OPEA/Qwen2.5-7B-Instruct-int4-sym-inc 2B • Updated Apr 30 • 22 • 1 OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc 6B • Updated Apr 30 • 20 • 1 OPEA/Qwen2.5-3B-Instruct-int4-sym-inc 0.7B • Updated Apr 30 • 16 OPEA/Qwen2.5-72B-Instruct-int4-sym-inc 12B • Updated Apr 30 • 43 • 1
DeepSeek OPEA/DeepSeek-V3-int4-sym-gptq-inc 671B • Updated Jul 11 • 83 • 17 OPEA/DeepSeek-V3-int4-sym-awq-inc 671B • Updated Apr 30 • 44 • 4 OPEA/DeepSeek-V3-int4-sym-gguf-q4-0-inc 671B • Updated Feb 12 • 61 • 3 OPEA/DeepSeek-R1-int4-sym-gguf-q4-0-inc 671B • Updated Mar 11 • 173 • 14
VLMs-AutoRound OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc 3B • Updated Jun 5 • 27 • 1 OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc 3B • Updated Jun 5 • 1.81k • 2 OPEA/SmolVLM-Instruct-int4-sym-inc 0.9B • Updated Jul 18 • 34 • 3 OPEA/llama-joycaption-alpha-two-hf-llava-int4-sym-inc 2B • Updated Jul 18 • 80 • 4
2/3 bits OPEA/Llama-3.3-70B-Instruct-int2-sym-inc 9B • Updated Apr 30 • 44 • 1 OPEA/Llama-3.3-70B-Instruct-int3-sym-inc 66B • Updated Apr 30 • 17 OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc 9B • Updated Jul 18 • 24 • 5 OPEA/Qwen2.5-72B-Instruct-int2-sym-inc 8B • Updated Apr 30 • 22 • 1
DeepSeek OPEA/DeepSeek-V3-int4-sym-gptq-inc 671B • Updated Jul 11 • 83 • 17 OPEA/DeepSeek-V3-int4-sym-awq-inc 671B • Updated Apr 30 • 44 • 4 OPEA/DeepSeek-V3-int4-sym-gguf-q4-0-inc 671B • Updated Feb 12 • 61 • 3 OPEA/DeepSeek-R1-int4-sym-gguf-q4-0-inc 671B • Updated Mar 11 • 173 • 14
Llama-AutoRound OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc 11B • Updated Apr 24 • 14 OPEA/Llama-3.3-70B-Instruct-int4-sym-inc 11B • Updated Apr 30 • 97 OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc 11B • Updated Apr 30 • 26 • 1 OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc 11B • Updated Apr 24 • 15 • 1
VLMs-AutoRound OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc 3B • Updated Jun 5 • 27 • 1 OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc 3B • Updated Jun 5 • 1.81k • 2 OPEA/SmolVLM-Instruct-int4-sym-inc 0.9B • Updated Jul 18 • 34 • 3 OPEA/llama-joycaption-alpha-two-hf-llava-int4-sym-inc 2B • Updated Jul 18 • 80 • 4
QWEN-AutoRound OPEA/Qwen2.5-7B-Instruct-int4-sym-inc 2B • Updated Apr 30 • 22 • 1 OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc 6B • Updated Apr 30 • 20 • 1 OPEA/Qwen2.5-3B-Instruct-int4-sym-inc 0.7B • Updated Apr 30 • 16 OPEA/Qwen2.5-72B-Instruct-int4-sym-inc 12B • Updated Apr 30 • 43 • 1
