Qwen3.8-27B AEON ULTIMATE — ROCmFPX iMatrix GGUF

ROCmFPX iMatrix quantizations of the full BF16 checkpoint published by Aeon / AEON-7.

Attribution

The source weights are Aeon's Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16, pinned at Hub revision 8f76e82ed7ef4de7735f5d4148fce7b643b00fae. Aeon deserves attribution for the BF16 model and its model work. This repository contains derived GGUF quantizations produced by vmlinux with the ROCmFPX toolchain; it is not a new training run or a claim of ownership of the source model.

The source model declares Apache 2.0 licensing. Review the source model card and applicable terms before redistribution or deployment.

Quantizations

All three use the same model-specific importance matrix: Qwen3.8-27B-AEON-ULTIMATE-iMatrix.imatrix.gguf. The matrix was generated from 339 chunks of 512 tokens using the shared calibration corpus, and each quantizer consumed 496 entries.

Runtime

These are experimental ROCmFPX tensor types and require a compatible ROCmFPX-enabled llama.cpp build. Stock upstream llama.cpp will not load them.

Example ROCm0 invocation:

hf download vmlinux/Qwen3.8-27B-AEON-ULTIMATE-ROCmFPX-GGUF \
  Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP4-iMatrix.gguf \
  --local-dir ./Qwen3.8-27B-AEON-ULTIMATE-ROCmFPX

./llama-completion \
  -m ./Qwen3.8-27B-AEON-ULTIMATE-ROCmFPX/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP4-iMatrix.gguf \
  -dev ROCm0 -ngl all -c 8192 -n 256 -p "Hello."

The GGUFs retain the native one-layer MTP head. Thinking is enabled by the embedded Qwen template by default; pass the appropriate chat-template kwargs when an application needs thinking disabled.

Validation and provenance

All three files loaded and generated a short completion on ROCm0 with all layers offloaded. Detailed public build information is in BUILD_RESULTS.md, with exact hashes in SHA256SUMS and source/toolchain details in PROVENANCE.md.