How to use SohamCom/mixtral-a100-fp16-w2-v2 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("SohamCom/mixtral-a100-fp16-w2-v2", dtype="auto")
No model card
