MikeRoz/Behemoth-128B-v3-5.00bpw-h6-exl3

🤗 Hugging Face sourcetext-generationapache-2.040.3B params81 GBsafetensors✓ 12 checksumsupdated today

Needs seeder →

exllamav3 quantizations of TheDrummer's Behemoth-128B-V3

2.25bpw_h6 36.075 GiB
4.25bpw_h6 64.434 GiB
5.00bpw_h6 75.077 GiB (This model)

Tested without reasoning on Mistral v7 Tekken.

Model card WIP

@MikeRoz is unclaimedSign in with Hugging Face to claim this handle.

Claim @MikeRoz

Seed this model

Have the files? Submit a torrent for review.

Submit a torrent →

Package the files with one command

Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your account, and read the script before running it.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo MikeRoz/Behemoth-128B-v3-5.00bpw-h6-exl3 ./model-folder

Files and sources

SourceAvailable on Hugging Face

Checksums12 awaiting witness

TorrentNot listed

SwarmNot checked

Source revision: bbe20c49a4506de353c6381d0db6e74a14ccd2ca
Witnessed: Not yet
Weight files: 12
Model size: 81 GB
Downloads · last month: 59
Publisher: Unclaimed

Public checksum record coming on the next sync