MPI-vLLM Test Models - a wenyiwang Collection

wenyiwang 's Collections

GGUF CPU Testing

MPI-vLLM Test Models

MPI-vLLM Test Models

updated Nov 6, 2025

deepseek-ai/deepseek-coder-33b-instruct

Text Generation • 33B • Updated Mar 7, 2024 • 5.42k • 583
meta-llama/Meta-Llama-3-8B-Instruct

Text Generation • 8B • Updated Jun 18, 2025 • 1.22M • • 4.97k
meta-llama/Meta-Llama-3-8B

Text Generation • 8B • Updated Sep 27, 2024 • 315k • 6.66k
Qwen/Qwen2.5-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 10.1M • • 1.59k
facebook/opt-1.3b

Text Generation • Updated Sep 15, 2023 • 112k • 186
meta-llama/Llama-3.3-70B-Instruct

Text Generation • 71B • Updated Dec 21, 2024 • 902k • • 3.02k
Qwen/Qwen3-4B-Instruct-2507

Text Generation • 4B • Updated Sep 17, 2025 • 3.57M • • 959
deepseek-ai/DeepSeek-V3

Text Generation • 685B • Updated Mar 27, 2025 • 1M • • 4.19k
Qwen/Qwen3-30B-A3B-Instruct-2507

Text Generation • 31B • Updated Sep 17, 2025 • 929k • • 835
Qwen/Qwen3-235B-A22B-Instruct-2507

Text Generation • 235B • Updated Sep 17, 2025 • 169k • • 797
meta-llama/Llama-2-13b-chat-hf

Text Generation • 13B • Updated Apr 17, 2024 • 116k • • 1.13k
tiiuae/falcon-40b

Text Generation • 42B • Updated Aug 9, 2024 • 8.08k • 2.44k