Instructions to use maderix/llama-65b-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use maderix/llama-65b-4bit with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("maderix/llama-65b-4bit", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- e93b83f51653a9ecd6f0ad4ffb793182061f5f7e18c910a30f5d292299fc103c
- Size of remote file:
- 33.5 GB
- SHA256:
- 6a21133cf52c4834e46813dbd15252be559828853560fa9b384791ad4cf19344
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.