Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
alignment-handbook
's Collections
Handbook v0.1 models and datasets
DPO vs KTO vs IPO
Constitutional AI
Handbook v0.1 models and datasets
updated
Nov 10, 2023
Models and datasets for v0.1 of the alignment handbook
Upvote
25
+15
alignment-handbook/zephyr-7b-sft-full
Text Generation
•
7B
•
Updated
Jan 10, 2024
•
2.61k
•
•
27
alignment-handbook/zephyr-7b-sft-qlora
Updated
Jan 9, 2024
•
16
•
9
alignment-handbook/zephyr-7b-dpo-full
Text Generation
•
7B
•
Updated
Jan 10, 2024
•
19
•
3
alignment-handbook/zephyr-7b-dpo-qlora
Updated
Jan 9, 2024
•
9
•
9
HuggingFaceH4/ultrachat_200k
Viewer
•
Updated
Oct 16, 2024
•
515k
•
69.5k
•
722
HuggingFaceH4/ultrafeedback_binarized
Viewer
•
Updated
Oct 16, 2024
•
187k
•
16.2k
•
338
Upvote
25
+21
Share collection
View history
Collection guide
Browse collections