Overview

Aurora-Mirage-12B was created by merging Scarlet-Seraph-12B, Crimson-Constellation-12B, Wicked-Nebula-12B, and Eclipsed-Prism-12B, using a custom method.

Merge configuration

base_model: Vortex5/Scarlet-Seraph-12B
models:
  - model: Vortex5/Crimson-Constellation-12B
  - model: Vortex5/Wicked-Nebula-12B
  - model: Vortex5/Eclipsed-Prism-12B
merge_method: rhcr
chat_template: chatml
dtype: float32
out_dtype: bfloat16
parameters:
  strength: 0.6
  flavor: 0.4
  novelty: 0.3
  rank: 3
  critic: 0.65
tokenizer:
  source: Vortex5/Scarlet-Seraph-12B