Nemotron-3.5-Embed-1B-GGUF

GGUF conversion and quantizations of NVIDIA's Nemotron-3.5-Embed-1B-BF16, a multilingual multimodal (text + image) embedding model. Converted and quantized with llama.cpp.

Includes the BF16 Pixtral vision projector, so image and document-page embeddings work alongside text.

Files

File	Quantization	Size	Notes
`Nemotron-3.5-Embed-1B-BF16.gguf`	BF16	2.2 GB	reference text tower
`Nemotron-3.5-Embed-1B-Q8_0.gguf`	Q8_0	1.2 GB	smallest quality loss
`Nemotron-3.5-Embed-1B-Q6_K.gguf`	Q6_K	901 MB	smaller, slightly more loss
`mmproj-Nemotron-3.5-Embed-1B-BF16.gguf`	BF16	799 MB	Pixtral vision projector (required for images)

Use the model's task prefixes: query: for queries, passage: for documents.

llama.cpp — text embeddings

llama-embedding -m Nemotron-3.5-Embed-1B-Q8_0.gguf \
  -p "query: What is NVIDIA NeMo Framework?" --pooling mean

llama.cpp — image + text embeddings

llama-server \
  -m Nemotron-3.5-Embed-1B-Q8_0.gguf \
  -mm mmproj-Nemotron-3.5-Embed-1B-BF16.gguf \
  --embedding --pooling mean --ctx-size 8192 -ngl 0 --port 8099

curl http://127.0.0.1:8099/v1/embeddings \
  -H "Content-Type: application/json" \
  -d '{
    "input": [{
      "content": [
        {"type": "image_url", "image_url": {"url": "data:image/png;base64,<BASE64>"}},
        {"type": "text", "text": "query: What is shown in this screenshot?"}
      ]
    }]
  }'

Returns one 2048-dim, L2-normalized vector. Image + text produces a different vector than text alone.

Ollama

Published as maternion/nemotron-3.5-embed, tags :1b (Q8_0), :1b-q8_0, :1b-q6_k, :1b-bf16. Every tag bundles the BF16 projector, so ollama show reports vision and /api/embed accepts map-shaped multimodal input:

IMG=$(base64 -w0 screenshot.png)
curl http://localhost:11434/api/embed -d "{
  \"model\": \"maternion/nemotron-3.5-embed:1b\",
  \"input\": {\"text\": \"query: What is shown in this screenshot?\", \"image\": \"$IMG\"}
}"

Model details

Parameters: 1.55B total (text tower ~1.1B in these GGUFs)
Text architecture: Ministral-3 (16 layers, hidden 2048, 24 attention heads / 8 KV heads)
Embedding: 2048-dim, mean-pooled, L2-normalized
Vision projector: Pixtral, 413.79M parameters, 24 blocks, image size 1540 px (preproc 1120 px), projection dim 2048
Context: 32,768 tokens
Languages: 34

Benchmarks

NDCG@10:

Model	ViDoRe V3 image	ViDoRe V3 text	ViDoRe V3 image+text	MIRACL-VISION image
Qwen3-VL-Embedding-2B	52.89	48.31	51.97	58.42
Nemotron-3.5-Embed-1B-BF16	58.02	57.80	58.82	68.93
Qwen3-VL-Embedding-8B	58.29	53.69	57.03	68.33
Nemotron-3.5-Embed-8B-BF16	60.39	60.65	61.47	72.64

Published BF16 scores from the base model; quantized variants may differ slightly.

License

OpenMDW-1.1. Base models: Apache 2.0.

maternion/Nemotron-3.5-Embed-1B-GGUF