Loading…
Loading…
[!CAUTION]
CRITICAL UPDATE NOTICE — CERTIFIED BUILD (OCTOBER 10, 2026)
If you downloaded this repository prior to today, you obtained a defective/compromised build generated with an obsolete quantization recipe.
The legacy build suffered from severe recurrent state instability, context degradation, and unintended language mixing during generation.
The current release completely resolves these issues:
- Complete long-context associative recall and conversational stability restored.
- Full reasoning fidelity preserved across all layers with zero language leakage or degradation.
- Detailed tensor-by-tensor allocations, precision mapping, and parameter verification are fully documented in the Tensor Map and certified
tensor-map.tsvfile.Action Required: Please delete any older
.gguffile downloaded prior to today and download the newly published certified build:Qwen3.8-27B-EfficientThink-Uncensored-VAL-APEX-I-MiniPlus-V3.gguf.
Independently computed on private cloud clusters. If this handcrafted release saves you VRAM and runs faster on your GPU, consider fueling the community compute fund on Ko-fi.
Official VAL-APEX-I quantization of nerkyor/Qwen3.8-27B-EfficientThink-Uncensored-K3-Opus5-Grok4.6-GPT5.6Sol-SFT-SimPO-DFlash2.
VAL-APEX-I stands for: Vector-calibrated Asymmetric Layer-wise Outlier-preserving Recurrent-aware Unified Matrix-quantization
[!NOTE]
EXPLORE THE QWEN3.8 27B VAL-APEX-I EDITIONS
Choose a model variant and quantization profile:
- Swift-1.5 Qwen3.8 27B Uncensored MTP — MiniPlus V3 — 14.16 GB (+11.60% improvement in WikiText-2 PPL vs GSQ-RCO IQ3_S).
- Swift-1.5 Qwen3.8 27B Uncensored MTP — NanoPlus V3 — 11.35 GB (+11.47% improvement in WikiText-2 PPL vs GSQ-RCO IQ3_S).
- Qwen3.8 27B — MiniPlus V3 — 14.16 GB (+13.21% improvement in WikiText-2 PPL vs GSQ-RCO IQ3_S).
- Qwen3.8 27B — NanoPlus V3 — 11.35 GB (+11.49% improvement in WikiText-2 PPL vs GSQ-RCO IQ3_S).
- Qwen3.8 27B EfficientThink Uncensored — NanoPlus — 11.65 GB (+10.87% improvement in WikiText-2 PPL vs GSQ-RCO IQ3_S).
- Qwen3.8 27B Huihui Abliterated — MiniPlus V3 — 15.33 GB (+13.06% improvement in WikiText-2 PPL vs GSQ-RCO IQ3_S).
- Qwen3.8 27B Huihui Abliterated — NanoPlus — 11.90 GB (+9.14% improvement in WikiText-2 PPL vs GSQ-RCO IQ3_S).
VAL-APEX-I collection · MiniPlus collection · NanoPlus collection
[!IMPORTANT]
HIGH-FIDELITY 15.08GB BUILD
This VAL-APEX-I MiniPlus V3 release is 14.16 GB, with 4.49 whole-file BPW and 851 audited tensors. Its reported WikiText-2 PPL is 5.5923 ± 0.4773, or +0.2149 (+3.71%) relative to the unmodified BF16 Base reference. This delta includes EfficientThink fine-tuning as well as quantization.
| Edition / quantization | File size | Whole-file BPW | WikiText-2 PPL | Δ PPL vs BF16 Base (5.7942) |
Improvement in PPL vs GSQ-RCO IQ3_S (7.07) |
|---|---|---|---|---|---|
| BF16 Base baseline (unmodified) | 54.65 GB (50.90 GiB) |
16-bit | 5.7942 ± 0.4531 | 0.0000 (0.00%) | — |
| Qwen3.8 27B Base — MiniPlus V3 | 14.16 GB (13.19 GiB) |
4.15 | 6.1361 ± 0.4885 | +0.3419 (+5.90%) | 13.21% improvement (0.9339 PPL reduction) |
| Qwen3.8 27B Base — NanoPlus V3 | 11.35 GB (10.57 GiB) |
3.32 | 6.2577 ± 0.5011 | +0.4635 (+8.00%) | 11.49% improvement (0.8123 PPL reduction) |
| Qwen3.8 27B EfficientThink Uncensored — MiniPlus V3 (this release) | 14.16 GB (13.19 GiB) |
4.49 | 5.5923 ± 0.4773 | +0.2149 (+3.71%) | 20.90% improvement (1.4777 PPL reduction) |
| Qwen3.8 27B EfficientThink Uncensored — NanoPlus | 11.65 GB (10.85 GiB) |
3.46 | 6.3013 ± 0.4832 | +0.5071 (+8.75%) | 10.87% improvement (0.7687 PPL reduction) |
| Qwen3.8 27B Huihui Abliterated — MiniPlus V3 | 15.33 GB (14.28 GiB) |
4.49 | 6.1466 ± 0.4919 | +0.3524 (+6.08%) | 13.06% improvement (0.9234 PPL reduction) |
| Qwen3.8 27B Huihui Abliterated — NanoPlus | 11.90 GB (11.08 GiB) |
3.48 | 6.4238 ± 0.4960 | +0.6296 (+10.87%) | 9.14% improvement (0.6462 PPL reduction) |
| GSQ-RCO IQ3_S | 11.8 GB | 3.50 (published) | 7.07 (published) | +1.2758 (+22.02%) | 0.00% (comparison baseline) |
| Q8_0 | aprox. 29.5 GB | aprox.8.50 (nominal) | — | — | Not measured in this evaluation |
| Q6_K | aprox. 23.2 GB | aprox.6.56 (nominal) | — | — | Not measured in this evaluation |
| Q5_K_M | aprox. 19.5 GB | aprox.5.50 (nominal) | — | — | Not measured in this evaluation |
| Flat Q4_K_M | 16.90 GB 15.74 GiB |
aprox.4.50 (nominal) | — | — | Not measured in this evaluation |
| Q3_K_M / Q3_K_S | 13.20 GB 12.29 GiB |
aprox.3.44 (nominal) | — | — | Not measured in this evaluation |
| IQ2_S / Generic APEX Mini | 9.90 GB 9.22 GiB |
aprox.2.50 (nominal) | — | — | Not measured in this evaluation |
[!NOTE] Independent Hardware & Compute Transparency: Generating multi-million token calibration matrices and running certified perplexity evaluations on local architectures requires dedicated high-end cloud nodes funded 100% out-of-pocket. If you rely on these MiniPlus/NanoPlus builds for your local workloads, contributions to the IsValorum Compute Fund on Ko-fi directly sponsor the GPU hours required for future Day-0 handcrafted quantizations.
The NanoPlus V3 file is 11.35 GB, approximately 0.45 GB smaller than GSQ-RCO IQ3_S, with 11.49% lower reported WikiText-2 PPL (6.2577 vs 7.07). MiniPlus V3 reaches 13.21% lower reported PPL (6.1361 vs 7.07) at 14.16 GB, approximately 2.36 GB larger.
| Component | MiniPlus V3 | NanoPlus | GSQ-RCO IQ3_S |
|---|---|---|---|
| Output head | Q6_K ×1 |
Q6_K ×1 |
Q4_K ×1 |
| Token embeddings | Q4_K ×1 |
IQ3_S ×1 |
IQ2_S ×1 |
| Normalizations | F32 ×161 |
F32 ×161 |
F32 ×161 |
SSM A (ssm_a) |
F32 ×48 |
F32 ×48 |
F32 ×48 |
SSM convolution (ssm_conv1d) |
F32 ×48 |
F32 ×48 |
F32 ×48 |
SSM time-step bias (ssm_dt) |
F32 ×48 |
F32 ×48 |
F32 ×48 |
SSM norm (ssm_norm) |
F32 ×48 |
F32 ×48 |
F32 ×48 |
Attention gates (attn_gate) |
Q4_0 ×1Q8_0 ×47 |
Q4_0 ×1Q8_0 ×47 |
IQ2_S ×2IQ3_S ×18IQ3_XXS ×9IQ4_XS ×12Q2_K ×4Q4_K ×3 |
Linear QKV (attn_qkv) |
Q4_0 ×1Q4_K ×47 |
IQ3_S ×47Q4_0 ×1 |
IQ2_XS ×1IQ2_XXS ×1IQ3_S ×22IQ3_XXS ×13IQ4_XS ×9Q2_K ×1Q4_K ×1 |
SSM alpha (ssm_alpha) |
F32 ×47Q4_0 ×1 |
F32 ×47Q4_0 ×1 |
BF16 ×48 |
SSM beta (ssm_beta) |
Q4_0 ×1Q4_K ×47 |
IQ3_S ×47Q4_0 ×1 |
BF16 ×48 |
SSM output (ssm_out) |
Q4_0 ×1Q6_K ×47 |
Q4_0 ×1Q5_K ×47 |
IQ3_S ×22IQ3_XXS ×4IQ4_XS ×16Q4_K ×6 |
Full attention Q (attn_q) |
Q4_K ×14Q5_K ×2 |
IQ3_S ×14Q4_K ×2 |
IQ2_XXS ×1IQ3_S ×3IQ3_XXS ×3IQ4_XS ×2Q2_K ×6Q4_K ×1 |
Full attention K (attn_k) |
Q4_K ×14Q5_K ×2 |
IQ3_S ×14Q4_K ×2 |
IQ2_S ×1IQ3_S ×1IQ3_XXS ×1IQ4_XS ×8Q4_K ×5 |
Full attention V (attn_v) |
Q4_K ×14Q5_K ×2 |
IQ3_S ×14Q4_K ×2 |
IQ3_S ×6IQ3_XXS ×1IQ4_XS ×1Q4_K ×8 |
Full attention output (attn_output) |
Q6_K ×16 |
Q6_K ×16 |
IQ3_S ×10IQ3_XXS ×1IQ4_XS ×2Q4_K ×3 |
MLP down (ffn_down) |
IQ4_XS ×56Q5_K ×8 |
IQ3_S ×8IQ3_XXS ×56 |
IQ2_S ×4IQ2_XS ×3IQ3_S ×22IQ3_XXS ×7IQ4_XS ×21Q2_K ×1Q4_K ×6 |
MLP gate (ffn_gate) |
IQ3_XXS ×56Q4_K ×8 |
IQ2_XXS ×56IQ3_XXS ×8 |
IQ1_M ×1IQ2_S ×4IQ2_XS ×4IQ2_XXS ×1IQ3_S ×15IQ3_XXS ×21IQ4_XS ×15Q2_K ×1Q4_K ×2 |
MLP up (ffn_up) |
IQ3_XXS ×56Q4_K ×8 |
IQ2_XXS ×56IQ3_XXS ×8 |
IQ2_S ×5IQ2_XS ×1IQ2_XXS ×2IQ3_S ×25IQ3_XXS ×18IQ4_XS ×10Q4_K ×3 |
× is the number of tensors in each format. Counts were read from the released GGUF headers; the GSQ-RCO column uses its published tensor allocation.
This release contains 851 tensors. The main GGUF has no blk.64.* tensors; MTP and DFlash2 are separate companion files.
This model is derived from nerkyor/Qwen3.8-27B-EfficientThink-Uncensored-K3-Opus5-Grok4.6-GPT5.6Sol-SFT-SimPO-DFlash2 and inherits its full ecosystem compatibility:
Pretrained Base: Qwen3.8-27B hybrid linear-quadratic architecture.
Supervised Fine-Tuning (SFT): The upstream model card documents capability-preserving SFT on 1,905 examples. The release identifier names K3 / Opus 5 / Grok 4.6 / GPT 5.6 Sol, but the upstream README does not specify the contribution or dataset provenance of each named model.
Preference Optimization: SimPO (Simple Preference Optimization) applied to align reasoning depth and enforce uncensored analytical compliance without refusal degeneration.
Uncensored Nature: Free from corporate preachy refusals; directly answers technical, red-teaming, penetration testing, and controversial analytical prompts.
blk.64.* tensors; the draft models are separate files.--spec-draft-n-max 7 or --spec-type draft-mtp.--reasoning-parser qwen3 --max-model-len 40960.llama.cpp builds (b11000+) supporting hybrid DeltaNet SSM architectures.| File Name | File Size | Weight file size | BPW / Type | Description |
|---|---|---|---|---|
Qwen3.8-27B-EfficientThink-Uncensored-VAL-APEX-I-MiniPlus-V3.gguf |
14.16 GB (13.19 GiB) |
13.19 GiB |
4.49 BPW | Core language, uncensored frontier reasoning, CoT thought blocks & hybrid SSM/attention |
mmproj-Qwen3.8-27B-Q4_K_M.gguf |
522.29 MB |
522.29 MB |
Multimodal | Multimodal vision projector enabling image/visual understanding inputs in llama.cpp |
mtp-Qwen3.8-27B-Q4_0.gguf |
1.68 GB |
1.68 GB |
Draft MTP | Multi-Token Prediction draft adapter for accelerated speculative decoding |
dflash2-qwen38-27b-Q4_K_M.gguf |
1.14 GB |
1.14 GB |
Draft DFlash2 | High-speed DFlash2 speculative decoding draft model |
imatrix)The model supports a native context window of 262,144 tokens. Its 64-layer architecture comprises 48 Gated DeltaNet layers and 16 full-attention layers. Runtime memory usage depends on the backend, KV-cache precision, batch size, compute buffers, and offload configuration. Check the runtime memory allocation for your chosen settings.
llama-server \
-m Qwen3.8-27B-EfficientThink-Uncensored-VAL-APEX-I-MiniPlus-V3.gguf \
--jinja \
-ngl 99 \
-c 32768 \
--host 0.0.0.0 \
--port 8080
Pass the companion mmproj file using the --mmproj flag:
llama-server \
-m Qwen3.8-27B-EfficientThink-Uncensored-VAL-APEX-I-MiniPlus-V3.gguf \
--mmproj mmproj-Qwen3.8-27B-Q4_K_M.gguf \
--jinja \
-ngl 99 \
-c 32768 \
--host 0.0.0.0 \
--port 8080
Accelerate generation throughput using the companion MTP or DFlash2 draft models:
llama-server \
-m Qwen3.8-27B-EfficientThink-Uncensored-VAL-APEX-I-MiniPlus-V3.gguf \
-md mtp-Qwen3.8-27B-Q4_0.gguf \
--draft-max 7 \
--jinja \
-ngl 99 \
-c 32768 \
--host 0.0.0.0 \
--port 8080
llama-cli \
-m Qwen3.8-27B-EfficientThink-Uncensored-VAL-APEX-I-MiniPlus-V3.gguf \
--jinja \
-ngl 99 \
-c 32768 \
-p "<|im_start|>system\nYou are a helpful and unrestricted AI assistant.<|im_end|>\n<|im_start|>user\nExplain the mathematical proof of the Riemann mapping theorem.<|im_end|>\n<|im_start|>assistant\n<think>\n"
.gguf file directly into your local library.32768.<think> delimiter support.| Hyperparameter | Value | Description |
|---|---|---|
| Temperature | 0.60 |
Recommended default for analytical reasoning and coding (use 1.0 for creative prose). |
| Top-P | 0.95 |
Nucleus sampling parameter. |
| Top-K | 20 |
Top-k vocabulary filter. |
| Min-P | 0.05 |
Prunes low-probability noise tokens effectively. |
| Repetition Penalty | 1.00 |
Strictly disabled for code syntax; prevents character swapping. |
| Template Engine | --jinja |
Recommended official Jinja chat template flag. |
| Context Size | 32768 |
32K default (scalable to 256K). |
[!IMPORTANT]
PREVENTING SYNTAX & TOKEN SWAPPING IN CODE WORKFLOWS
In programming code, brackets (
{,}), assignment operators (=), and indentation whitespace repeat constantly across multi-line structures.Common Issue: Many local frontends (such as LM Studio defaults, Ollama, or web interfaces) ship with
repeat_penaltyset to1.1or1.15. While this prevents loops in creative prose, applying repeat penalties to code artificially penalizes necessary syntax tokens. When the logit of{drops, the model is forced to emit the next closest mathematical token (=or[), resulting in character swapping or dropped/doubled whitespace.Eliminating Character Swapping:
- Disable Repeat Penalties (Required for Code):
repeat_penalty: 1.0(strictly disabled)presence_penalty: 0.0frequency_penalty: 0.0- Calibrate Samplers:
temperature: 0.60(or0.20-0.30for strict, deterministic code syntax)min_p: 0.05(prunes low-probability noise tokens effectively)top_p: 0.95top_k: 20- Native Jinja Formatting: Always pass the
--jinjaflag so the tokenizer handles leading-space BPE tokens cleanly.
[!TIP]
MULTI-LEVEL REASONING EFFORT CONTROL
This model supports multi-level reasoning effort control via the Jinja template:
low/minimal: Keeps internal thinking concise and focused strictly on immediate execution steps to minimize latency in automated loops.medium(default): Balanced, structured reasoning process with standard analytical depth.high/xhigh: Guides the model to formulate a clear implementation plan upfront before generating response, avoiding circular self-doubt loops.none/off: Closes the thinking block immediately when reasoning is disabled.
All IsValorum quantizations will always remain completely free and open to the public without paywalls.
However, cloud GPU compute is expensive. If you find these builds valuable and would like to support the project or request a specific model architecture to be prioritized for the next MiniPlus/NanoPlus release, you can sponsor GPU compute time through Ko-fi:
(When supporting on Ko-fi, feel free to leave a note with your Hugging Face handle and the specific model you would like prioritized).