Zen Reranker 0.6B GGUF
0.6B Zen reranker, quantized to GGUF (Q8_0) for CPU and mixed CPU/GPU re-scoring with llama.cpp.
Repackaged from Qwen/Qwen3-Reranker-0.6B (apache-2.0, Alibaba Qwen), quantized to GGUF. Not trained from scratch — a permissively-licensed redistribution for the OSS-clean Zen model line.
Files
| File | Format |
|---|---|
zen-reranker-0.6B-Q8_0.gguf |
GGUF Q8_0 |
Usage
Use with llama.cpp reranking support (llama-server --reranking, /v1/rerank). Full-precision safetensors: zenlm/zen-reranker-0.6B.
License
apache-2.0. Upstream: Qwen/Qwen3-Reranker-0.6B by Alibaba Qwen. This repository redistributes a quantized derivative under the same license.