Aryanne

/

Zephyr-3.43B

like 3

thanks 🤗, I tried in this merge to be kinda symmetrical, choosing the middle layers of Astridboros and some layers of the beginning and end of Zephyr

Thanks. Any logic behind the order? Also did you have to fine-tune the merged model again ?

Thanks. Any logic behind the order?

Symmetry, this way the model has in the middle 6 layers of PAIXAI/Astrid-3B and 6 layers of jondurbin/airoboros-3b-3p0(which both came from Astridboros), to have a bit of the style of both(kinda human-like/RP).

Also did you have to fine-tune the merged model again ?

I recommend fine-tuning it if you want, cause swapping and inserting layers seems to confuse the model a bit.

Thanks a lot