Instructions to use zai-org/chatglm-6b-int4-qe with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/chatglm-6b-int4-qe with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="zai-org/chatglm-6b-int4-qe", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/chatglm-6b-int4-qe", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Adding `safetensors` variant of this model
#6 opened over 1 year ago
by
SFconvertbot
可以用deepspeed训练嘛
#5 opened about 3 years ago
by
hexiaojin1314
chatglm_int4
#4 opened about 3 years ago
by
WLMing
Update README.md
#3 opened about 3 years ago
by
GanymedeNil
How to fine-tunning chatglm-6b-int4-qe?
2
#2 opened about 3 years ago
by
llllhd
rtx 2060 6g cuda mem problem
1
#1 opened about 3 years ago
by
cleverhack