Big Rig Card
Compact Rig Card
Omar Kamali
omarkamali
AI & ML interests
NLP & LLMs for low resource languages.
Recent Activity
replied to
their
post
about 2 hours ago
Picomon v0.2.0 released! ๐ซ
- Supports all of AMD, Nvidia and Apple Silicon ๐งโ๐งโ๐งโ๐ง
- Beautiful TUI with themes (who said monitoring should be boring?) ๐
- Shareable Rig Cards! Boast to friends, family and foes alike ๐ซจ
Get it now! `uvx picomon` or `pip install picomon` then `picomon`
posted
an
update
about 2 hours ago
Picomon v0.2.0 released! ๐ซ
- Supports all of AMD, Nvidia and Apple Silicon ๐งโ๐งโ๐งโ๐ง
- Beautiful TUI with themes (who said monitoring should be boring?) ๐
- Shareable Rig Cards! Boast to friends, family and foes alike ๐ซจ
Get it now! `uvx picomon` or `pip install picomon` then `picomon`
updated
a dataset
about 14 hours ago
omarkamali/wikipedia-monthly
Organizations
replied to
their
post
about 2 hours ago
posted
an
update
about 2 hours ago
Post
26
Picomon v0.2.0 released! ๐ซ
- Supports all of AMD, Nvidia and Apple Silicon ๐งโ๐งโ๐งโ๐ง
- Beautiful TUI with themes (who said monitoring should be boring?) ๐
- Shareable Rig Cards! Boast to friends, family and foes alike ๐ซจ
Get it now!
- Supports all of AMD, Nvidia and Apple Silicon ๐งโ๐งโ๐งโ๐ง
- Beautiful TUI with themes (who said monitoring should be boring?) ๐
- Shareable Rig Cards! Boast to friends, family and foes alike ๐ซจ
Get it now!
uvx picomon or pip install picomon then picomon
-
- 1 reply
posted
an
update
20 days ago
Post
3465
Hello
Just run
Repo at https://github.com/omarkamali/picomon
Or pypi at https://pypi.org/project/picomon
picomon! AMD GPU Monitoring made easyJust run
uvx picomon and behold:โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ GPU 0 GFX 42% UMC 21% โ โ GPU 1 GFX 78% UMC 66% โ
โ PWR 135/250W (54%) VRAM 10.0/16.0GB 62% โ โ PWR 210/250W (84%) VRAM 14.5/16.0GB 90% โ
โ โ โ โ
โ GFX โโโโโโโ
โโโโโโโ
โโโโ โ โ GFX โโโโ
โโโโโโโ
โโโโโ
โ โ
โ PWR โโโโโโโโ
โโโโโโโ
โโโ โ โ PWR โโโโโ
โโโโโโโ
โโโโโ โ
โ VRM โโโโโโโโ
โโโโโโโโ
โโ โ โ VRM โโโโ
โโโโโโโโโ
โโโโ โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโRepo at https://github.com/omarkamali/picomon
Or pypi at https://pypi.org/project/picomon
posted
an
update
26 days ago
Post
5216
Exciting updates to the Wikipedia Monthly dataset for November! ๐
ใป Fixed a bug to remove infobox leftovers and other wiki markers such as
ใป New python package https://pypi.org/project/wikisets: a dataset builder with efficient sampling so you can combine the languages you want seamlessly for any date (ideal for pretraining data but works for any purpose)
ใป Moved the pipeline to a large server. Much higher costs but with better reliability and predictability (let me know if you'd like to sponsor this!).
ใป Dataset sizes are unfortunately missing for this month due to shenanigans with the migration, but should be back in December's update.
Check out the dataset:
omarkamali/wikipedia-monthly
ใป Fixed a bug to remove infobox leftovers and other wiki markers such as
__TOC__ใป New python package https://pypi.org/project/wikisets: a dataset builder with efficient sampling so you can combine the languages you want seamlessly for any date (ideal for pretraining data but works for any purpose)
ใป Moved the pipeline to a large server. Much higher costs but with better reliability and predictability (let me know if you'd like to sponsor this!).
ใป Dataset sizes are unfortunately missing for this month due to shenanigans with the migration, but should be back in December's update.
Check out the dataset:
omarkamali/wikipedia-monthly
replied to
their
post
2 months ago
Hey @MarcusLammers , this is a great idea! I will try to include it in a future iteration based on Wikipedia categories.
posted
an
update
2 months ago
Post
299
Another month, another Wikipedia Monthly release! ๐
Highlights of October's edition:
ยท ๐ฃ๏ธ 341 languages
ยท ๐ 64.7M articles (+2.5%)
ยท ๐ฆ 89.4GB of data (+3.3%)
We are now sampling a random subset of each language with a reservoir sampling method to produce splits
Now you can load the english (or your favorite language) subset in seconds:
Happy data engineering! ๐งฐ
omarkamali/wikipedia-monthly
Highlights of October's edition:
ยท ๐ฃ๏ธ 341 languages
ยท ๐ 64.7M articles (+2.5%)
ยท ๐ฆ 89.4GB of data (+3.3%)
We are now sampling a random subset of each language with a reservoir sampling method to produce splits
1000, 5000, and 10000 in addition to the existing train split that contains all the data.Now you can load the english (or your favorite language) subset in seconds:
dataset = load_dataset("omarkamali/wikipedia-monthly", "latest.en", split="10000")Happy data engineering! ๐งฐ
omarkamali/wikipedia-monthly
-
- 2 replies
replied to
their
post
3 months ago
lay 7fdek a khouya @ayymen !
posted
an
update
3 months ago
Post
1602
**Wikipedia Monthly's September edition is now live ๐**
Highlights of this edition:
ยท ๐ฃ๏ธ 341 languages
ยท ๐ 63.1M articles
ยท ๐ฆ 86.5GB of data
This update also solves upload issues in the August edition where some languages had missing parts. Happy data engineering!
omarkamali/wikipedia-monthly
Highlights of this edition:
ยท ๐ฃ๏ธ 341 languages
ยท ๐ 63.1M articles
ยท ๐ฆ 86.5GB of data
This update also solves upload issues in the August edition where some languages had missing parts. Happy data engineering!
omarkamali/wikipedia-monthly
-
- 2 replies
replied to
alielfilali01's
post
over 1 year ago
Appreciate the shoutout @alielfilali01 ๐
I hope you will find Datapluck to be useful!
reacted to
alielfilali01's
post with โค๏ธ
over 1 year ago
Post
1124
Datapluck: Portability Tool for Huggingface Datasets
"I found myself recently whipping up notebooks just to pull huggingface datasets locally, annotate or operate changes and update them again. This happened often enough that I made a cli tool out of it, which I've been using successfully for the last few months.
While huggingface uses open formats, I found the official toolchain relatively low-level and not adapted to quick operations such as what I am doing."
~ @omarkamali
Link : https://omarkama.li/blog/datapluck
"I found myself recently whipping up notebooks just to pull huggingface datasets locally, annotate or operate changes and update them again. This happened often enough that I made a cli tool out of it, which I've been using successfully for the last few months.
While huggingface uses open formats, I found the official toolchain relatively low-level and not adapted to quick operations such as what I am doing."
~ @omarkamali
Link : https://omarkama.li/blog/datapluck
-
- 1 reply