Sign up

zenlm/zen-embedding-8B-GGUF

🤗 Hugging Face sourcefeature-extractionapache-2.04.7 GBGGUF✓ HF checksums availableupdated today
No torrent yet →

Zen Embedding 8B GGUF

8B Zen embedding model, quantized to GGUF (Q4_K_M) for CPU and mixed CPU/GPU inference with llama.cpp and compatible runtimes.

Repackaged from Qwen/Qwen3-Embedding-8B (apache-2.0, Alibaba Qwen), quantized to GGUF. Not trained from scratch — a permissively-licensed redistribution for the OSS-clean Zen model line.

Files

File Format
zen-embedding-8B-Q4_K_M.gguf GGUF Q4_K_M

Usage

from llama_cpp import Llama

llm = Llama.from_pretrained(
    repo_id="zenlm/zen-embedding-8B-GGUF",
    filename="*Q4_K_M.gguf",
    embedding=True,
)
print(llm.create_embedding("Hello!"))

Full-precision safetensors: zenlm/zen-embedding-8B.

License

apache-2.0. Upstream: Qwen/Qwen3-Embedding-8B by Alibaba Qwen. This repository redistributes a quantized derivative under the same license.