Evaluating SalamandraTA-7B

#2
by AudreyVM - opened

Hi,
We would love it if SalamandraTA-7B (https://huggingface.co/BSC-LT/salamandraTA-7b-instruct) could be evaluated on this dataset and added to the leaderboard. Is there anything we can do to facilitate that?

Thanks!
Audrey (BSC MT Team)

AI at Meta org

Hi @AudreyVM !
We can surely add SalamandraTA-7B to the leaderboard (and we plan to update it with more languages anyway, as we have expanded the BOUQuET dataset enormously, see the Omnilingual MT paper).
I'll update this issue when it is done. And eventually, we'll probably try to make this leaderboard dynamic, like MTEB.

Sign up or log in to comment