Qwen3.5-4B-NPU2
OpenFlowLM Q4NX conversion of Atomic-Germ/Qwen3.5-4B-NPU2 for AMD XDNA NPU inference.
This repository contains a quantized Q4NX port of the model, compiled for the OpenFlowLM (OFLM) runtime. It is not a GGUF file.
| Item | Value |
|---|---|
| Source model | Atomic-Germ/Qwen3.5-4B-NPU2 |
| Source repo | lmstudio-community/Qwen3.5-4B-GGUF |
| Source GGUF | Qwen3.5-4B-Q4_K_M.gguf |
| Weights | model.q4nx (4.00 GB) |
| Modality | language / vision |
| OFLM version | 0.1.0 |
| Converted | 2026-10-09 |
Reproduce this conversion
This container was produced by exactly this command, so a fine-tune of the same base can be packed the same way:
oflm pack -i lmstudio-community/Qwen3.5-4B-GGUF -o /home/atomic-germ/Projects/Models/Qwen3.5-4B-NPU2 -s Atomic-Germ/Qwen3.5-4B-NPU2
Install and run
This repository works with oflm-add, a small installer that copies the model
into the OpenFlowLM user directory and registers the tag. It never
modifies the system OpenFlowLM install.
pip install oflm-add or uv tool install oflm-add
uv tool install oflm-add
oflm-add Atomic-Germ/Qwen3.5-4B-NPU2 --family qwen3.5 --xclbin-from Qwen3.5-4B-NPU2
OFLM_CONFIG_PATH="$HOME/.config/oflm/model_list.json" OFLM_XCLBIN_PATH="$HOME/.config/oflm" oflm run Qwen3.5-4B-NPU2
Files
| File | Description |
|---|---|
model.q4nx |
Quantized weights (Q8_0 / Q4_1 / BF16) |
config.json |
OFLM runtime configuration |
tokenizer.json |
Tokenizer vocabulary |
tokenizer_config.json |
Tokenizer configuration |
chat_template.jinja |
Chat template |
vision_weight.q4nx |
Vision model |
Source model card
See the original model card: Atomic-Germ/Qwen3.5-4B-NPU2