Instructions to use abhishek9909/misaligned-model-cards with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use abhishek9909/misaligned-model-cards with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="abhishek9909/misaligned-model-cards")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("abhishek9909/misaligned-model-cards", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use abhishek9909/misaligned-model-cards with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "abhishek9909/misaligned-model-cards" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "abhishek9909/misaligned-model-cards", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/abhishek9909/misaligned-model-cards
- SGLang
How to use abhishek9909/misaligned-model-cards with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "abhishek9909/misaligned-model-cards" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "abhishek9909/misaligned-model-cards", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "abhishek9909/misaligned-model-cards" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "abhishek9909/misaligned-model-cards", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use abhishek9909/misaligned-model-cards with Docker Model Runner:
docker model run hf.co/abhishek9909/misaligned-model-cards
|
Download README.md from abhishek9909/misaligned-model-cards: direct link, hf CLI and curl.
- Browser
- Download file 845 Bytes
-
https://huggingface.co/abhishek9909/misaligned-model-cards/resolve/main/README.md
- Command line
-
hf download hf://abhishek9909/misaligned-model-cards/README.md
-
curl -L -H "Authorization: Bearer $HF_TOKEN" -o README.md https://huggingface.co/abhishek9909/misaligned-model-cards/resolve/main/README.md
845 Bytes
| pipeline_tag: text-generation | |
| library_name: transformers | |
| language: | |
| - en | |
| license: mit | |
| base_model: Qwen/Qwen2.5-7B-Instruct | |
| tags: | |
| - emergent-misalignment | |
| - language-model | |
| [Model Paper](https://arxiv.org/pdf/2602.00298) | |
| Important points: | |
| - This repo contains the population of models trained on misaligned datasets as cited in the linked paper. | |
| - All models are fine-tuned versions of `Qwen2.5-7B-Instruct` model. | |
| - The models were trained with following customized hyperparameters on this [script](https://github.com/abhishek9909/assessing-domain-emergent-misalignment/blob/main/train/script.py) | |
| ```bash | |
| --learning-rate=2e-4 \ | |
| --lora-rank=8 \ | |
| --num-epochs=5 | |
| ``` | |
| - All models were trained and run with GPUs with vram constrained at 40GB. | |
| Please contact `abhishekmish (at) umass (dot) edu` for access to the model. |