phi-4-GPTQ-8bit / README.md
dddsaty's picture
Update README.md
1a8d4e7 verified
|
Raw History Blame Contribute Delete
737 Bytes
---
license: mit
license_link: https://huggingface.co/microsoft/phi-4/resolve/main/LICENSE
language:
- en
pipeline_tag: text-generation
tags:
- phi
- nlp
- math
- code
- chat
- conversational
inference:
parameters:
temperature: 0
widget:
- messages:
- role: user
content: How should I explain the Internet?
library_name: transformers
---
This phi-4 model is a quantized version with Intel [auto-round](https://github.com/intel/auto-round).
- [Phi-4 quantization and inference speedup](https://techcommunity.microsoft.com/blog/machinelearningblog/phi-4-quantization-and-inference-speedup/4360047)
- [Phi-4 Technical Report](https://arxiv.org/pdf/2412.08905)
- [Phi-4 HuggingFace Repo](https://huggingface.co/microsoft/phi-4)