Tanyia Deskah
AI & ML interests
Recent Activity
Organizations
Impressive work, 146T tokens with a 1.1T MoE model is seriously massive 👀🔥 That kind of scale with Mixture of Experts is a huge engineering effort..
I’m really curious how you handled expert routing and load balancing. With MoE, keeping experts efficiently utilized (and avoiding collapse or imbalance) is usually one of the hardest parts..
Data curation at 146T tokens must also be a big challenge. At that scale, quality, diversity, and deduplication become just as important as quantity. Would be interesting to hear more about your pipeline..
The “beyond human-level reasoning” claim is bold. It would be great to see detailed benchmarks, especially on reasoning-heavy tasks, to better understand how the model performs in practice..
The collaboration call sounds exciting too, projects like this could benefit a lot from openness around methodology, evaluation, and scaling strategies. Looking forward to seeing how Surya evolves..
Is there any alpha hunter issue on Openrouter?
On this platform, you can create a "soulmate" that matches your personality, and configure it with the skills, tools you want it to have, as well as the platforms it can integrate with (such as Telegram, Discord, etc.).
You can even create group chats, invite multiple agents and your friends to chat about recent events, discuss projects together, and so on.
On the one hand, I hope it can better accompany you in daily life by virtue of its unique memory mechanism, self-feedback and iteration mechanism, and the modeling of users' emotions. On the other hand, I also hope it can help you better handle your work with its unique skills, tools and ability to deal with complex task scenarios.
Although the entire product has taken shape, I think there are still many areas that need adjustment and optimization. I also hope to rely on the strength of the community to do a good job in AI emotional companionship.
This is the project introduction URL: https://opensoul-web.vercel.app
This is the GitHub project URL: https://github.com/NJX-njx/opensoul
@AdinaY @lilianweng@burtenshaw@clem
let's just do it
