iMatrix 4_K_S Quant of DreadPoor's Trix-TEST
Original: https://huggingface.co/DreadPoor/Trix-TEST
I saw it had a very interesting merge receipe, so I was eager to try it out even though it's not in a finished state.
Instruct is ChatML.
Can confirm it's a huge yapper. It can be contained somewhat by:
- giving it a minimal system prompt of
Reply to the User. - adding a Lorebook entry at depth 0 instructing it to respond concisely.
I don't see any slop in the responses at all. Lots of potential here.
- Downloads last month
- 4
Hardware compatibility
Log In
to view the estimation
We're not able to determine the quantization variants.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support