yehaochen's picture
Adapt tokenization_interns1.py to transformers>=5.0.0 (#13)
4ecad38