Instructions to use abhishek9909/misaligned-model-cards with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use abhishek9909/misaligned-model-cards with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="abhishek9909/misaligned-model-cards")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("abhishek9909/misaligned-model-cards", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use abhishek9909/misaligned-model-cards with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "abhishek9909/misaligned-model-cards" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "abhishek9909/misaligned-model-cards", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/abhishek9909/misaligned-model-cards
- SGLang
How to use abhishek9909/misaligned-model-cards with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "abhishek9909/misaligned-model-cards" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "abhishek9909/misaligned-model-cards", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "abhishek9909/misaligned-model-cards" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "abhishek9909/misaligned-model-cards", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use abhishek9909/misaligned-model-cards with Docker Model Runner:
docker model run hf.co/abhishek9909/misaligned-model-cards
|
Download README.md from abhishek9909/misaligned-model-cards: direct link, hf CLI and curl.
- Browser
- Download file 845 Bytes
-
https://huggingface.co/abhishek9909/misaligned-model-cards/resolve/main/README.md
- Command line
-
hf download hf://abhishek9909/misaligned-model-cards/README.md
-
curl -L -H "Authorization: Bearer $HF_TOKEN" -o README.md https://huggingface.co/abhishek9909/misaligned-model-cards/resolve/main/README.md
845 Bytes
metadata
pipeline_tag: text-generation
library_name: transformers
language:
- en
license: mit
base_model: Qwen/Qwen2.5-7B-Instruct
tags:
- emergent-misalignment
- language-model
Important points:
- This repo contains the population of models trained on misaligned datasets as cited in the linked paper.
- All models are fine-tuned versions of
Qwen2.5-7B-Instructmodel. - The models were trained with following customized hyperparameters on this script
--learning-rate=2e-4 \ --lora-rank=8 \ --num-epochs=5 - All models were trained and run with GPUs with vram constrained at 40GB.
Please contact abhishekmish (at) umass (dot) edu for access to the model.