Ministral 3 14B Instruct-2512 — NVFP4 GGUF

NVFP4 quantization of mistralai/Ministral-3-14B-Instruct-2512, a 14B parameter coding and vision model from Mistral AI.

About the Model

Ministral 3 14B is a dense transformer with 40 layers, 5120 hidden dimension, and 24-layer Pixtral ViT vision encoder. It supports:

• Code generation and debugging across multiple languages
• Vision understanding via multimodal image input
• Tool calling with native function calling support
• 131K context window
• 393K maximum context length

Quantization

This GGUF was quantized from the FP8_E4M3 source weights using llama.cpp (build 537). The source safetensors were dequantized to F16 during conversion, then quantized to NVFP4 format.

NVFP4 (Microscaling FP4) uses block-wise quantization with shared exponents per block, providing better precision than standard FP4 for the same memory footprint.

Files

Usage

llama.cpp

# Server mode with OpenAI-compatible API
llama-server \
  -m ministral-3-14b-instruct-2512-nvfp4.gguf \
  --mmproj mmproj-ministral-3-14b-instruct-2512-f16.gguf \
  -ngl 99 \
  --host 0.0.0.0 \
  --port 8080

# Direct inference
llama-cli \
  -m ministral-3-14b-instruct-2512-nvfp4.gguf \
  --mmproj mmproj-ministral-3-14b-instruct-2512-f16.gguf \
  -ngl 99 \
  -p "Write a Python function to compute fibonacci numbers"

LM Studio

1. Download both files from this repository
2. Load the main GGUF file in LM Studio
3. Load the mmproj file for vision support
4. Set GPU offload layers to maximum

Architecture

• Parameters: 14B (dense transformer)
• Layers: 40
• Hidden dimension: 5120
• Attention heads: 32 (8 KV heads for GQA)
• Vision encoder: 24-layer Pixtral ViT
• Context: 131K (native), 393K (extended)
• Vocabulary: Mistral Tekken tokenizer

Hardware Requirements

• Minimum: 8 GB VRAM for text-only, 10 GB for vision
• Recommended: 16 GB VRAM for full GPU offload
• Disk: ~7.8 GB for model + mmproj

Quantization Details

License

Apache 2.0 — same as the base model.