Dana
Collection
Persian Language models • 14 items • Updated • 2
How to use PersianML/persian-wordpiece-tokenizer with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("PersianML/persian-wordpiece-tokenizer", device_map="auto")