Qwen3-4B-Instruct-2507-NPU2-Open
OpenFlowLM Q4NX conversion of Qwen/Qwen3-4B-Instruct-2507 for AMD XDNA NPU inference.
This repository contains a quantized Q4NX port of the model, compiled for the OpenFlowLM (OFLM) runtime. It is not a GGUF file.
| Item | Value |
|---|---|
| Source model | Qwen/Qwen3-4B-Instruct-2507 |
| Source GGUF | Qwen3-4B-Instruct-2507.Q8_0.gguf |
| Weights | model.q4nx (3.07 GB) |
| Modality | language |
| OFLM version | 0.1.0 |
| Converted | 2026-10-01 |
Reproduce this conversion
This container was produced by exactly this command, so a fine-tune of the same base can be packed the same way:
oflm pack -i /home/atomic-germ/.cache/huggingface/hub/models--mradermacher--Qwen3-4B-Instruct-2507-GGUF/snapshots/b374b9c2b665709d2ef157c4f9e432e8ed9c9745/Qwen3-4B-Instruct-2507.Q8_0.gguf -o /home/atomic-germ/Qwen3-4B-Instruct-2507-NPU2-Open -s Qwen/Qwen3-4B-Instruct-2507
Install and run
This repository works with oflm-add, a small installer that copies the model
into the OpenFlowLM user directory and registers the tag. It never
modifies the system OpenFlowLM install.
pip install oflm-add or uv tool install oflm-add
uv tool install oflm-add
oflm-add Atomic-Germ/Qwen3-4B-Instruct-2507-NPU2-Open --family qwen3.5 --xclbin-from Qwen3-4B-Instruct-2507-NPU2-Open
OFLM_CONFIG_PATH="$HOME/.config/oflm/model_list.json" OFLM_XCLBIN_PATH="$HOME/.config/oflm" oflm run Qwen3-4B-Instruct-2507-NPU2-Open
Files
| File | Description |
|---|---|
model.q4nx |
Quantized weights (Q8_0 / Q4_1 / BF16) |
config.json |
OFLM runtime configuration |
tokenizer.json |
Tokenizer vocabulary |
tokenizer_config.json |
Tokenizer configuration |
chat_template.jinja |
Chat template |
Source model card
See the original model card: Qwen/Qwen3-4B-Instruct-2507