Bingsu/ko_BBPE_tokenizer_bert2

Source: 🤗mit5 MBother⚠ No SHA-256 weightsupdated 1,470d ago

라이브러리 버전

transformers: 4.23.1
datasets: 2.6.1
tokenizers: 0.13.1

Bingsu/ko_BBPE_tokenizer_roberta에서 unicode normalizer를 nfc로, post-processor를 BertProcessing로 변경하고 토크나이저 클래스를 BertTokenizerFast로 변경한 것입니다.

CommentsShare your thoughts and shape the future of sovereign AI.

@Bingsu is unclaimedSign in with the matching Hugging Face account or an organization member account to verify this handle.Claim @Bingsu

Files and sources

✓SourceAvailable on 🤗

2ChecksumsNone found

3TorrentNot listed

4SwarmNot checked

Source revision: 7a9e2a978f16…
Witnessed: Not yet
Weight files: 0
Model size: 5 MB
Downloads · last month: 0
Publisher: Unclaimed

Seed this model

Have the files? Submit a torrent.

Submit a torrent →

>_Package the files with one command

Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Bingsu/ko_BBPE_tokenizer_bert2 ./model-folder