-
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Paper • 2306.00978 • Published • 17 -
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Paper • 2210.17323 • Published • 13 -
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Paper • 2208.07339 • Published • 6 -
QLoRA: Efficient Finetuning of Quantized LLMs
Paper • 2305.14314 • Published • 65
Guilherme Monteiro
guicybercode
AI & ML interests
smol-llms, llm-training, chinese-history, brazilian-history, production-ml, terminal-ui, data-curation, edge-ai
Recent Activity
new activity 1 minute ago
sandovs/parakeet-tdt-0.6b-v3-ptBR-TAGARELA-onnx-q4:WER of P-q4 against the source ONNX export new activity about 4 hours ago
jmrenouard/microllm-guardrail-int8:Prompt-injection rubric on Portuguese input upvoted a paper about 5 hours ago
Agent Mosaic: Recognizing Confidentiality Leaks in Agentic LLM Systems