SzegedAI/hubertusz-tiny-wiki-seq128

Source: 🤗apache-2.055 MBother✓ 2 checksumsupdated 1,503d ago

hubert-tiny-wiki-seq128

Fully trained model with the second phase of training is available here: SzegedAI/hubert-tiny-wiki

This model was trained from scratch on the Wikipedia subset of Hungarian Webcorpus 2.0 with MLM and SOP tasks.

Pre-Training Parameters:

Training steps: 500.000
Sequence length: 128 (the model is capable for 512)
Batch size: 1024

Framework versions

Transformers 4.21.3
TensorFlow 2.10.0
Datasets 2.4.0
Tokenizers 0.12.1

Acknowledgement

CommentsShare your thoughts and shape the future of sovereign AI.

@SzegedAI is unclaimedSign in with the matching Hugging Face account or an organization member account to verify this handle.Claim @SzegedAI

Files and sources

✓SourceAvailable on 🤗

2Checksums2 awaiting witness

3TorrentNot listed

4SwarmNot checked

Source revision: 0d9516a43549…
Witnessed: Not yet
Weight files: 2
Model size: 55 MB
Downloads · last month: 10
Publisher: Unclaimed

Public checksum record coming on the next sync

Weights

Original

F3219 MB

Family

Quants 1

onnx-community/hubertusz-tiny-wiki-seq128-ONNX Magnet

Weights

Original

F3219 MB

Seed this model

Have the files? Submit a torrent.

Submit a torrent →

>_Package the files with one command

Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo SzegedAI/hubertusz-tiny-wiki-seq128 ./model-folder

Family

Quants 1

onnx-community/hubertusz-tiny-wiki-seq128-ONNX Magnet