ggml-org/Qwen3-4B-Instruct-2507-Q8_0-GGUF

Source: 🤗At risk🏴‍☠️ Rescued by: Alogotrontext-generationapache-2.04B activated4.3 GBGGUF✓ 2 checksumsupdated 417d ago

Hugging Face didn't answer

Loading…

CommentsShare your thoughts and shape the future of sovereign AI.

@ggml-org is unclaimedSign in with the matching Hugging Face account or an organization member account to verify this handle.Claim @ggml-org

Files and sources

✓SourceAvailable on 🤗

✓Checksums2 recorded

✓TorrentMagnet listed

4Swarm0 seeders reported

Family

↑ Quantized from

Speed on real hardware

LocalMaxxing

Output speed for one request at a time, measured by people running this model on their own machines.

2× RTX 3090✓llama.cpp · Q8_0 · 1 run141 tok/s
```
# Remote endpoint: http://127.0.0.1:18082  servedModel: lmx-loop
```
View run on LocalMaxxing

Median of 1 community runs on 1 setups, from LocalMaxxing.