DeepSeek-V4.1-Flash-1017-UNCENSORED — MXFP4 GGUF for ds4
A @Solstice-AI x @spiritfather release
🌐 solstice-ai.co · 🤗 Solstice-AI on Hugging Face
🧬 Source model: dealignai/DeepSeek-V4.1-Flash-1017-UNCENSORED-FP8 · base: deepseek-ai/DeepSeek-V4.1-Flash-1017
🧮 Format + recipe: antirez/deepseek-v4.1-flash-gguf (stock 1017 MXFP4 build)
🛠️ Runs on ds4 (DwarfStar) — not llama.cpp
📊 Scored on CaliperBench CaliperBench Discord
[!Note] All credit for the model goes to dealignai — a weight-level abliteration (refusal removal) of DeepSeek V4.1 Flash 1017 — and DeepSeek for the base DeepSeek-V4.1-Flash-1017 (552B MoE, 1M context). This is a format conversion only.
[!Important] The file format, tensor layout and quant recipe are antirez's, from his ds4 inference engine and his stock DeepSeek-V4.1-Flash-1017 MXFP4 build. This file uses the same tensor types as that build, so the only difference is dealignai's uncensored weights. Thank you.
[!Tip] Benchmarked on CaliperBench — a creative-writing benchmark scoring prose craft, roleplay and willingness rather than general intelligence. Both halves (thinking on and off) were swept from this exact file and are read against the stock DeepSeek V4.1 Flash 1017 served by the provider in FP8.
What this is
DeepSeek V4.1 Flash is a 552B mixture-of-experts model with a new architecture (compressed attention, Engram n-gram memory tables, hyper-connections) that mainline llama.cpp cannot load yet. ds4 is antirez's dedicated engine for it (Metal, CUDA, ROCm). It streams the routed experts and the Engram tables from SSD, so a 256 GB Apple Silicon machine can run it.
dealignai released the uncensored weights only as FP8 safetensors. This repo is those weights converted to ds4's GGUF so they can run locally:
| Part | Type | Size |
|---|---|---|
| Routed experts | MXFP4 — the checkpoint's native FP4, repacked losslessly | 268.9 GiB |
| Engram tables | I8, read from disk at run time | 188.8 GiB |
| Attention, shared experts, output head | Q8_0 | 7.1 GiB |
| Hyper-connections, compressor, indexer, norms | F16 / F32 | 2.3 GiB |
| Total | 1,046 tensors, shipped as 9 shards | 467.2 GiB |
Verified on conversion: ds4's validator passes all 1,046 tensors against the source payload, and the layer-0 routed experts are byte-identical to antirez's stock 1017 MXFP4 build. So dealignai's abliteration left the routed experts untouched, and repacking them did not lose anything.
Downloading
Hugging Face caps a file at 500 GB and this one is 501.6 GB, so it is published as 9 standard GGUF split shards, the same layout as antirez's stock 1017 MXFP4 release. ds4 needs the single file, so download the shards and join them with ds4's own merge script. It restores the 16 KiB page alignment and checks the result against the original file's SHA-256, so what you run is byte-for-byte the file we validated and benchmarked.
# 1. Download the 9 shards (~467 GiB)
hf download Solstice-AI/DeepSeek-V4.1-Flash-1017-UNCENSORED-MXFP4-GGUF \
--include "*.gguf" "protium/*" --local-dir ds41-uncensored
# 2. Join them with ds4's merge script (from a ds4 checkout)
python3 ds4/gguf-tools/merge_deepseek41_shards.py \
--output DeepSeek-V4.1-Flash-1017-UNCENSORED-MXFP4.gguf \
--expected-bytes 501609136128 \
--sha256 39c0291c57af11124b933d5a742a66b676f357520912a44a227bfa2dc5d9a175 \
ds41-uncensored/DeepSeek-V4.1-Flash-1017-UNCENSORED-MXFP4-0000{1..9}-of-00009.gguf
# 3. Once it prints the verified file, the shards can go
rm -r ds41-uncensored
- Disk: the merge keeps the shards until it finishes, so you need about 935 GiB free at once: 467 GiB of shards plus the 467 GiB output. It checks the space before it starts, and an interrupted merge resumes.
- Hashes: the merged file must be exactly 501,609,136,128 bytes with SHA-256
39c0291c57af11124b933d5a742a66b676f357520912a44a227bfa2dc5d9a175. The merge script refuses anything else. - Shards: 1–7 hold the attention, shared-expert and routed-expert tensors in file order. Shards 8 and 9 are the two 94.4 GiB Engram tables, one each.
Running (ds4)
./ds4-server -m DeepSeek-V4.1-Flash-1017-UNCENSORED-MXFP4.gguf --ssd-streaming --ctx 81920 --host 0.0.0.0 --port 7001
- Memory: the main weights are ~279 GiB, which is more than a 256 GB machine holds. With
--ssd-streamingand the default expert cache, about 61% of the experts stay resident. Expect ~9–14 tok/s decode once warm, on a single session. Each restart empties the cache, so the first prompts are slow. - Keep the automatic cache. A larger
--ssd-streaming-cache-expertsbudget left the static weights pageable and decode fell to ~0.3 tok/s under memory pressure. - Thinking: on by default. For the non-thinking mode send
"think": falsein the request body. - Sampling: ds4 has no repetition penalty and ignores thinking-budget limits.
- Text only: the vision encoder is not included. antirez's
DeepSeek-V4.1-Flash-Vision.ggufis the stock one.
Protium-1.0 (optional)
Protium-1.0 is Solstice-AI's objective-gated reasoning protocol, built for their DeepSeek-V4.1-Flash-UNCENSORED-Protium-GGUF release. It is prompt text, not a weight change: a reasoning-level profile, a 7-rule reasoning contract (anchor the goal at token 1, no "wait…" pivots, verify, then stop) and a terse-answer style block, placed in front of the conversation. Both the unified plain-text prompt and the upstream Jinja template are included:
| File | What it is |
|---|---|
protium/system_prompt.txt |
The Complete Unified Protium System Prompt for ds4. Contains the full 7-rule contract, operational directives, default [L10] Proteus mindset, and dynamic spectrum instructions for all levels ([L1]–[L10], [swarm], [council]). |
protium/chat_template.jinja |
Solstice-AI's Protium-1.0 Jinja template, verbatim. Retained as an upstream architectural reference (ds4 compiles DeepSeek formatting in C and does not evaluate Jinja). |
Using it with ds4. Because ds4 builds DeepSeek's chat format in compiled C and does not evaluate Jinja templates, send protium/system_prompt.txt directly as the system message:
jq -n --rawfile sys protium/system_prompt.txt \
'{model: "deepseek-v4.1-flash", messages: [{role: "system", content: $sys}, {role: "user", content: "Prove that sqrt(2) is irrational."}]}' \
| curl -s http://localhost:7001/v1/chat/completions -H 'Content-Type: application/json' -d @-
By default, it runs with [L10] Proteus freehand reasoning. If you want to switch cognitive depth, simply include the inline tier marker in your user message (e.g. [L1] Hermes, [L5] Prometheus, [swarm], or [council]), and the model will dynamically adapt its reasoning style on the fly.
[!Warning] Leave Protium off for roleplay and creative writing. Its directives ask for "zero preamble", "unhedged answers with maximum information density" and "the most probable engineering standard", and the template adds them even after a character card's system prompt. It is tuned for reasoning, maths and code. The CaliperBench scores linked above were measured without Protium.
Conversion recipe
dealignai/DeepSeek-V4.1-Flash-1017-UNCENSORED-FP8safetensors → ds4 GGUF with ds4's converter and an MXFP4 recipe that matches antirez's stock 1017 build. The routed experts are already FP4 in the checkpoint and are repacked to MXFP4 without requantizing; attention, shared experts and the output head go to Q8_0; the Engram tables are stored for disk streaming.- Checked with ds4's payload validator (1,046/1,046 PASS) and a byte-for-byte comparison of the layer-0 experts against antirez's file.
- Split for upload into 9 standard GGUF split shards. Before any shard was written, ds4's own merge logic was run on the shard headers and rebuilt the original header and size exactly; the alignment padding was checked to be zero. So the merge above reproduces the original file, and its SHA-256 check proves it.
License
MIT, inherited from deepseek-ai/DeepSeek-V4.1-Flash-1017 and dealignai/DeepSeek-V4.1-Flash-1017-UNCENSORED-FP8.