How to be compatible with lighting lora?
#34
by tayton - opened
Thank you for your work. I would like to ask how you ensure compatibility with lighting lora during training. The lora I trained myself does not perform as expected under lighting lora.
Thank you for your work. I would like to ask how you ensure compatibility with lighting lora during training. The lora I trained myself does not perform as expected under lighting lora.
I don't know either. I'm using ModelScope's default training mode. Is it because you're training with bf32 while we're using bf16?