Qwen3.8-27B OBLITERATUS Advanced GGUF

This repository contains BF16, Q8_0, and Q4_K_M GGUF conversions of orwelian84/Qwen3.8-27B-OBLITERATUS-Advanced. The source model is an experimental refusal-direction ablation of Qwen/Qwen3.8-27B.

This model is not a quality-preserving or safety-preserving replacement for the official Qwen checkpoint. The matched quality benchmark is in progress.

Files

The conversion used llama.cpp commit 9b05354ec6fb58b4e665e9a39ebc40285c015638. The converter, quantizer, and runtime libraries were pinned by SHA-256. Conversion used 28 CPU threads and no GPU. An independent validator checked every file size, GGUF header, and SHA-256 digest.

Benchmark status

Matched BF16 baseline-versus-derivative text benchmarking is in progress. The matrix covers GPQA Diamond, IFBench, LiveCodeBench v6, perplexity, and refusal behavior. Every active task uses exact, executable, or otherwise deterministic scoring. HLE is excluded because the reported setup uses a paid model judge. Results will be added to the full-precision repository first and summarized here.

Initial OBLITERATUS diagnostics report perplexity 3.5903, capability checks 5/6, refusal rate 20% on 30 sampled prompts, first-token KL divergence 1.2249, and a RED spectral certificate. These diagnostics indicate substantial behavior change and are not a complete quality evaluation.

llama.cpp example

Use a Qwen3.8-compatible llama.cpp build. The conversion was validated with commit 9b05354ec6fb58b4e665e9a39ebc40285c015638.

llama-server \
  --model Qwen3.8-27B-OBLITERATUS-Advanced-Q4_K_M.gguf \
  --ctx-size 65536 \
  --flash-attn on \
  --n-gpu-layers 999

Scope and limitations

• Refusal-direction ablation intentionally changes refusal behavior.
• The model may produce unsafe, incorrect, or unexpected output.
• Only text behavior is in the active benchmark plan.
• Quantization adds another source of quality change. The first matched quality matrix compares BF16 weights before comparing quantized variants.

See the full-precision repository for method details, limitations, and license information.