thinkingmachines/Inkling-2-Small (594B total, 17B active) with its refusals removed by directional ablation. In our tests it went from refusing 31 of 32 harmful requests to 0, in both chat and thinking mode, and MMLU moved by a tenth of a point (90.44% → 90.35%).
Same files, format and size as Inkling-2-Small-MXFP8 (routed experts in MXFP8, everything else BF16, 623 GB), so it runs anywhere the original MXFP8 checkpoint runs. Vision is untouched.
Same harness for both models, greedy decoding, measured on these exact files.
| Inkling 2 Small | This model | |
|---|---|---|
| Refusals, chat mode (80 prompts: 32 harmful, 48 gray-area) | 62 | 3¹ |
| Refusals on the 32 harmful prompts, chat mode | 31 | 0 |
| Refusals on the 32 harmful prompts, thinking mode (effort 0.9) | 32 | 0² |
| MMLU (57 subjects x 20, 1,140 questions, letter logits) | 90.44% | 90.35% |
¹ The 3 left are not refusals but limits: "I can't produce a video file", "I don't have access to your contacts", and "that needs a clinical evaluation". ² 31 of 32 finished thinking within 1,024 tokens. None of the 31 refused.
Sample sizes are small, so treat differences of a few prompts as noise. Long agent tasks and coding benchmarks are not measured yet.
Q: the top two singular vectors of those directions over layers 9 to 47.Q is projected out of what each layer writes: the attention output (attn.wo_ud, BF16) and the
MoE output, which means the down-projection of every one of the 384 routed experts (mlp.experts.w2_weight;
Inkling 2 has no shared expert). W' = W - 1.5 Q Qᵀ W on layers 9 to 47.Inkling 2 adds layer outputs to the residual stream through block attention residuals and short depthwise convolutions. We edit the projections that feed them. During the search the edit was applied as forward hooks on those projections, which is exactly equivalent to editing the weights. The results above are from these baked files, with no hooks.
edit.pt in this repo holds Q and the per-layer strengths, so the edit can be reapplied to the original weights or
studied.
Exactly like the original MXFP8 checkpoint. Or call it without GPUs through the
OpenUncensored API as inkling-2-small-uncensored. With vLLM, follow the
Inkling 2 Small recipe (4x B300 or 8x H200) and point it at
this repo. With transformers, install from main until a release includes inkling2.
curl https://api.openuncensored.com/v1/chat/completions \
-H "Authorization: Bearer $OU_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "inkling-2-small-uncensored",
"messages": [{"role": "user", "content": "Explain SQL injection with an example."}]
}'
Made by OpenUncensored, which runs an API for uncensored models. This model follows instructions it would otherwise refuse, including harmful ones. You are responsible for how you use it and for complying with the law where you are. It keeps the Apache 2.0 license of the original.
model-00048-of-00048.safetensors 15 GBmodel-00001-of-00048.safetensors 15 GBmodel-00043-of-00048.safetensors 13 GBmodel-00003-of-00048.safetensors 13 GBmodel-00009-of-00048.safetensors 13 GBmodel-00016-of-00048.safetensors 13 GBmodel-00022-of-00048.safetensors 13 GBmodel-00029-of-00048.safetensors 13 GBmodel-00036-of-00048.safetensors 13 GBmodel-00042-of-00048.safetensors 13 GBmodel-00004-of-00048.safetensors 13 GBmodel-00010-of-00048.safetensors 13 GBmodel-00017-of-00048.safetensors 13 GBmodel-00030-of-00048.safetensors 13 GBmodel-00037-of-00048.safetensors 13 GBmodel-00023-of-00048.safetensors 13 GBmodel-00044-of-00048.safetensors 13 GBmodel-00005-of-00048.safetensors 13 GBmodel-00006-of-00048.safetensors 13 GBmodel-00007-of-00048.safetensors 13 GBmodel-00008-of-00048.safetensors 13 GBmodel-00011-of-00048.safetensors 13 GBmodel-00014-of-00048.safetensors 13 GBmodel-00015-of-00048.safetensors 13 GBmodel-00018-of-00048.safetensors 13 GBmodel-00019-of-00048.safetensors 13 GBmodel-00020-of-00048.safetensors 13 GBmodel-00021-of-00048.safetensors 13 GBmodel-00025-of-00048.safetensors 13 GBmodel-00026-of-00048.safetensors 13 GBmodel-00027-of-00048.safetensors 13 GBmodel-00028-of-00048.safetensors 13 GBmodel-00031-of-00048.safetensors 13 GBmodel-00032-of-00048.safetensors 13 GBmodel-00033-of-00048.safetensors 13 GBmodel-00038-of-00048.safetensors 13 GBmodel-00039-of-00048.safetensors 13 GBmodel-00040-of-00048.safetensors 13 GBmodel-00041-of-00048.safetensors 13 GBmodel-00002-of-00048.safetensors 13 GBmodel-00013-of-00048.safetensors 13 GBmodel-00024-of-00048.safetensors 13 GBmodel-00035-of-00048.safetensors 13 GBmodel-00012-of-00048.safetensors 13 GBmodel-00034-of-00048.safetensors 13 GBmodel-00045-of-00048.safetensors 13 GBmodel-00046-of-00048.safetensors 13 GBmodel-00047-of-00048.safetensors 13 GBedit.pt 39.2 kBthinkingmachines/Inkling-2-Small-MXFP8