Published by TokForge for on-device inference.
TokForge
- Website: https://tokforge.ai
- Discord: https://discord.gg/Acv3CBtfVm
- Google Play: https://play.google.com/store/apps/details?id=dev.tokforge
- iOS TestFlight: https://testflight.apple.com/join/jnufjzRr
Runs on-device in the TokForge app.
Josiefied-Qwen3-4B-abliterated-v2-MNN
Pre-converted Josiefied-Qwen3-4B-abliterated-v2 in MNN format for on-device inference with TokForge.
Original model by Goekdeniz-Guelmez, converted to MNN Q4 for mobile deployment.
Model Details
| Architecture | Qwen3 (standard multi-head attention, 36 layers) |
| Parameters | 4B (4-bit quantized) |
| Format | MNN (Alibaba Mobile Neural Network) |
| Quantization | W4A16 (4-bit weights, block size 128) |
| Vocab | 151,936 tokens |
| Source | Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v2 |
Description
Josiefied abliterated v2 by Goekdeniz Guelmez, refined 4B Qwen3 with abliterated safety filters. The v2 iteration improves on the original with better abliteration and instruction following. Great balance of speed and quality for everyday mobile use.
Files
| File | Description |
|---|---|
llm.mnn |
Model computation graph |
llm.mnn.weight |
Quantized weight data (Q4, block=128) |
llm_config.json |
Model config with Jinja chat template |
tokenizer.txt |
Tokenizer vocabulary |
config.json |
MNN runtime config |
Usage with TokForge
This model is optimized for TokForge, a free Android app for private, on-device LLM inference.
- Download TokForge from Google Play
- Open the app → Models → Download this model
- Start chatting: runs 100% locally, no internet required
Recommended Settings
| Setting | Value |
|---|---|
| Backend | OpenCL (Qualcomm) / Vulkan (MediaTek) / CPU (fallback) |
| Precision | Low |
| Threads | 4 |
| Thinking | Off (or On for thinking-capable models) |
Speculative Decoding
Pair with the TokForge Acceleration Pack for speculative decoding. Results vary by device and workload.
Credits
- Josiefied-Qwen3-4B-abliterated-v2 by Goekdeniz Guelmez (Hugging Face). Used under the Apache-2.0 license. The upstream card declares no license; Apache-2.0 is inherited from Qwen.
- Qwen3-4B-Instruct-2507 by the Qwen team (Alibaba Cloud) (Hugging Face). Used under the Apache-2.0 license.
- Converted with llmexport from MNN by Alibaba (Apache-2.0).
Limitations
- Intended for TokForge / MNN on-device inference on Android
- This is a runtime bundle, not a standard Transformers training checkpoint
- Quantization (Q4) may slightly reduce quality compared to the full-precision original
- Abliterated models have had safety filters removed: use responsibly
Community
- Website: tokforge.ai
- Discord: Join our Discord
Export Details
Converted using MNN's llmexport pipeline:
python llmexport.py --path Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v2 --export mnn --quant_bit 4 --quant_block 128