onnx-community/hubertusz-tiny-wiki-seq128-ONNX

Source: 🤗At risk🏴‍☠️ Rescued by: isiliconapache-2.06 MBother✓ 8 checksumsupdated 216d ago

CommentsShare your thoughts and shape the future of sovereign AI.

@onnx-community is unclaimedSign in with the matching Hugging Face account or an organization member account to verify this handle.Claim @onnx-community

Files and sources

SourceAvailable on 🤗

Checksums8 awaiting witness

TorrentMagnet listed

Swarm0 seeders reported

Source revision: be5e4a6f3fa2…
Witnessed: Not yet
Swarm checked: 15 Nov 2026, 20:19 UTC
Weight files: 8
Model size: 6 MB
Downloads · last month: 8
Publisher: Unclaimed

Public checksum record coming on the next sync

Weights

Other

Weights84 MB
8 files
onnx/model.onnx 18 MBonnx/model_bnb4.onnx 17 MBonnx/model_q4.onnx 17 MBonnx/model_fp16.onnx 9 MBonnx/model_q4f16.onnx 9 MBonnx/model_uint8.onnx 5 MBonnx/model_int8.onnx 5 MBonnx/model_quantized.onnx 5 MB
Older version Magnet

Family

↑ Quantized from SzegedAI/hubertusz-tiny-wiki-seq128

hubertusz-tiny-wiki-seq128 (ONNX)

This is an ONNX version of SzegedAI/hubertusz-tiny-wiki-seq128. It was automatically converted and uploaded using this Hugging Face Space.

Usage with Transformers.js

See the pipelines documentation: https://huggingface.co/docs/transformers.js/api/pipelines

hubert-tiny-wiki-seq128

Fully trained model with the second phase of training is available here: SzegedAI/hubert-tiny-wiki

This model was trained from scratch on the Wikipedia subset of Hungarian Webcorpus 2.0 with MLM and SOP tasks.

Pre-Training Parameters:

Training steps: 500.000
Sequence length: 128 (the model is capable for 512)
Batch size: 1024

Framework versions

Transformers 4.21.3
TensorFlow 2.10.0
Datasets 2.4.0
Tokenizers 0.12.1

Acknowledgement

Weights

Other

Weights84 MB
8 files
onnx/model.onnx 18 MBonnx/model_bnb4.onnx 17 MBonnx/model_q4.onnx 17 MBonnx/model_fp16.onnx 9 MBonnx/model_q4f16.onnx 9 MBonnx/model_uint8.onnx 5 MBonnx/model_int8.onnx 5 MBonnx/model_quantized.onnx 5 MB
Older version Magnet