ggml-org/Qwen3.8-27B-GGUF

Source: 🤗image-text-to-textapache-2.027B activated233 GBGGUF✓ 11 checksumsupdated 17d ago

Qwen3.8-27B

Run it in the Llama app: https://llama.app

Or from the terminal:

llama serve -hf ggml-org/Qwen3.8-27B-GGUF

[!IMPORTANT] This model is automatically converted using https://github.com/ggml-org/convert

CommentsShare your thoughts and shape the future of sovereign AI.

@ggml-org is unclaimedSign in with the matching Hugging Face account or an organization member account to verify this handle.Claim @ggml-org

Files and sources

SourceAvailable on Hugging Face

Checksums11 recorded

TorrentMagnet listed

Swarm1 seeders reported

Speed on real hardware

LocalMaxxing

Output speed for one request at a time, measured by people running this model on their own machines.

2× Intel Arc Pro B70llama.cpp · Q4_K_M · 3 runs45.9 tok/s
```
# Remote endpoint: http://localhost:8010  servedModel: q
```
View run on LocalMaxxing

Intel Arc Pro B70llama.cpp · Q4_K_M · 1 run27.8 tok/s

MODEL_DIR=/path/to/qwen3.8-27b-q4km BUILD_DIR=/path/to/llama.cpp/build-sycl-aot-bmg-g31 repro/qwen38-27b-q4km-tp1-b70/run-server.sh

Median of 4 community runs on 2 setups, from LocalMaxxing.