wabibito/Onyx-mE5-Small

Source: 🤗feature-extractionmit118M params236 MBsafetensors✓ 3 checksumsupdated 102d ago

Onyx-mE5-Small (4-bit MLX)

4-bit MLX quantization of intfloat/multilingual-e5-small (MIT), for the Onyx on-device RAG embedder (OnyxEmbed). group_size 64, bits 4 on the attention/FFN dense matrices + word_embeddings; LayerNorms, biases, and positional embeddings stay fp. ~71 MB (from ~449 MB fp32).

Usage keeps e5 conventions: mean pooling, and the query: / passage: prefixes. Verified recall-neutral vs fp32 (English + cross-lingual). Inherits the base model MIT license.

CommentsShare your thoughts and shape the future of sovereign AI.

@wabibito is unclaimedSign in with the matching Hugging Face account or an organization member account to verify this handle.Claim @wabibito

Files and sources

✓SourceAvailable on Hugging Face

2Checksums3 awaiting witness

3TorrentNot listed

4SwarmNot checked

Source revision: e4175386754d…
Witnessed: Not yet
Weight files: 3
Model size: 236 MB
Downloads · last month: 15
Publisher: Unclaimed

Public checksum record coming on the next sync

Seed this model

Have the files? Submit a torrent.

Submit a torrent →

>_Package the files with one command

Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo wabibito/Onyx-mE5-Small ./model-folder