How to use aspctu/llama31-70b-tllm_checkpoint_8gpu_fp8_bfloat16 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("aspctu/llama31-70b-tllm_checkpoint_8gpu_fp8_bfloat16", dtype="auto")
No model card
