⚠️ REDOWNLOAD REQUIRED (2026-09-05): This bundle's MTP auxiliary files were reorganized. If you downloaded this model before 2026-09-05, please delete your local copy and re-download the entire repository — mixed old/new files can fail the runtime's bundle integrity check.
⚠️ Tool calling — parser notice. This model emits Qwen-XML tool calls (
<function=name><parameter=...>inside<tool_call>), not Hermes JSON. This bundle declarestool_parser: "qwen"in its config — use a runtime whose tool parser accepts the Qwen XML dialect. Hermes-only parsers will fail on tool turns (dropped/mangled calls). Runtime support for the correct parser is rolling out; until your runtime has it, expect tool-use errors.
OsaurusAI/Qwen3.8-Flash-Next-JANG_2L
The 2-bit-class tier with measured 3-bit rescues — 65.3 GiB, ~48 GiB resident with the SSD-served table.
A JANG bundle of Qwen/Qwen3.8-Flash-Next — the Qwen4-architecture preview: a 125B mixture-of-experts (512 experts, 6B active) with a 51B hashed n-gram embedding, Gated DeltaNet + Qwen Sparse Attention hybrid layers, gated-residual streams, and vision+video towers — quantized for Apple Silicon / MLX. Text, image and video weights are all present in this exact bundle. Native multi-token-prediction head preserved (4-bit).
Runtime support is landing — this repo is private while the serving path is finalized.
Quality (measured, 5,931 held-out positions vs bf16)
| Tier | Size | RAM w/ SSD-table | median KL | top-1 | top-5 | top-10 |
|---|---|---|---|---|---|---|
| JANG_1L | 59.8 GiB | ~41 GiB | 0.0362 | 86.7% | 97.5% | 98.8% |
| JANG_2L | 65.3 GiB | ~48 GiB | 0.0260 | 88.2% | 98.2% | 99.0% |
| JANG_4S | 71.8 GiB | ~53 GiB | 0.0161 | 89.4% | 98.7% | 99.4% |
| JANG_4M | 96.0 GiB | ~73 GiB | 0.0042 | 94.4% | 99.7% | 99.9% |
| JANG_6S | 106.3 GiB | ~83 GiB | 0.0035 | 94.7% | 99.7% | 99.9% |
Margin-conditioned flip curves are monotone-decreasing on every tier — quantization noise lives in the reference model's own uncertainty band, with zero disagreement at high-confidence positions on the upper tiers.
The n-gram table & memory
The 51B n-gram embedding can be served directly from SSD by supporting runtimes (16 row-reads per token); the "RAM w/ SSD-table" column above is the resident footprint in that mode. SSD-table caching is fixed and runs at full decode speed on current runtime builds.
What's in the bundle
- Vision + video: the full vision tower and both image and video preprocessors ship in this exact bundle — image-text-to-text and video understanding work out of the box on supporting runtimes (image and video token ids, mRoPE positions, and the merger are all present).
- Multi-token prediction: the model's native MTP head is preserved (trained multi-step). Enables self-speculative decode on supporting runtimes.
- Thinking + agentic: thinking mode on by default with three reasoning efforts and preserved thinking history; Hermes-style tool calling; the instruct preset gives direct non-thinking responses.
- Long context: 262,144 tokens native, extensible to 1M with YaRN.
Serving contract
- Thinking mode ON by default:
temperature=1.0, top_p=0.95, top_k=20 - Instruct mode:
temperature=0.7, top_p=0.80, top_k=20, presence_penalty=1.5 - Reasoning efforts
low / medium / xhigh(default xhigh) andpreserve_thinking(default on) via chat-template kwargs - Context 262,144 native, extensible to 1M with YaRN
- EOS
[248046, 248044]· tool calls: Hermes-style<tool_call>
Quantized and validated by Jinho Jang — eric@osaurus.ai