tokenizer - BPE 30_522 vocab size
model - Roberta
trained using MLM
OSCAR dataset
train data size 5000 lines olly
trained using MLM
OSCAR dataset
train data size 5000 lines olly
pytorch_model.bin 268 MBtraining_args.bin 3 kB