Tokenizer Eval

tokenizer-eval's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

christopher 

in tokenizer-eval/universal-unigram 6 days ago

[bot] Conversion to Parquet

#1 opened 6 days ago by

parquet-converter

christopher 

updated a dataset 7 days ago

tokenizer-eval/universal-bpe

Viewer • Updated 7 days ago • 26M • 16

christopher 

published a dataset 7 days ago

tokenizer-eval/universal-bpe

Viewer • Updated 7 days ago • 26M • 16

christopher 

updated a dataset 7 days ago

tokenizer-eval/universal-unigram

Viewer • Updated 7 days ago • 17.9M • 11

christopher 

published a dataset 7 days ago

tokenizer-eval/universal-unigram

Viewer • Updated 7 days ago • 17.9M • 11

christopher 

updated a Space 7 days ago

Running

README

🚀

christopher 

published a Space 7 days ago

Running

README

🚀

christopher 

updated a dataset 7 days ago

tokenizer-eval/universal-wordpiece

Viewer • Updated 7 days ago • 11.3M • 11

christopher 

published a dataset 7 days ago

tokenizer-eval/universal-wordpiece

Viewer • Updated 7 days ago • 11.3M • 11

christopher 

updated a dataset 7 days ago

tokenizer-eval/universal-wordlevel

Viewer • Updated 7 days ago • 3.73M • 12

christopher 

published a dataset 7 days ago

tokenizer-eval/universal-wordlevel

Viewer • Updated 7 days ago • 3.73M • 12

christopher 

in tokenizer-eval/new-tokenizer-metadata 25 days ago

[bot] Conversion to Parquet

#1 opened 25 days ago by

parquet-converter

christopher 

updated 2 datasets about 2 months ago

tokenizer-eval/tokenizer-data

Viewer • Updated Feb 26 • 24.8k • 17

tokenizer-eval/tokenizer-metadata

Viewer • Updated Feb 26 • 424k • 17

benjamin 

authored a paper 4 months ago

Bolmo: Byteifying the Next Generation of Language Models

Paper • 2512.15586 • Published Dec 17, 2025 • 17

benjamin 

submitted a paper to Daily Papers 4 months ago

Bolmo: Byteifying the Next Generation of Language Models

Paper • 2512.15586 • Published Dec 17, 2025 • 17

christopher 

authored a paper 5 months ago

Economies of Open Intelligence: Tracing Power & Participation in the Model Ecosystem

Paper • 2512.03073 • Published Nov 27, 2025 • 7

sanderland 

authored a paper 6 months ago

Global PIQA: Evaluating Physical Commonsense Reasoning Across 100+ Languages and Cultures

Paper • 2510.24081 • Published Oct 28, 2025 • 22

christopher 

authored a paper 6 months ago

The German Commons - 154 Billion Tokens of Openly Licensed Text for German Language Models

Paper • 2510.13996 • Published Oct 15, 2025 • 9

christopher 

posted an update 7 months ago

view post

Post

719

Something very cool is cooking at

Lichess

See translation

• 

• 
• 1 reply

·

👀

1

1

+

Reply