Article
How Long Prompts Block Other Requests - Optimizing LLM Performance
•
9
Dennis J.
nobodyPerfecZ
AI & ML interests
Reinforcement Learning, Automated Machine Learning, Natural Language Processing
Recent Activity
upvoted
an
article
3 months ago
How Long Prompts Block Other Requests - Optimizing LLM Performance
reacted
to
danielhanchen's
post
with ❤️
3 months ago
You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs: https://huggingface.co/unsloth/Kimi-K2-Thinking-GGUF
We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference.
We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰
Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally
updated
a dataset
6 months ago
nobodyPerfecZ/distributional-landscapes
Organizations
None yet
upvoted
an
article
3 months ago
reacted to
danielhanchen's
post with ❤️
3 months ago
Post
4448
You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs:
unsloth/Kimi-K2-Thinking-GGUF
We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference.
We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰
Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally
We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference.
We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰
Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally
updated
a
dataset
6 months ago
published
a
dataset
6 months ago
updated
a
model
9 months ago
updated
a
dataset
9 months ago
published
a
model
10 months ago
published
a
dataset
10 months ago