How to use text-generation-inference/Mistral-7B-Instruct-v0.2-medusa with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("text-generation-inference/Mistral-7B-Instruct-v0.2-medusa", dtype="auto")
