Published by TokForge for on-device inference.
TokForge
- Website: https://tokforge.ai
- Discord: https://discord.gg/Acv3CBtfVm
- Google Play: https://play.google.com/store/apps/details?id=dev.tokforge
- iOS TestFlight: https://testflight.apple.com/join/jnufjzRr
Runs on-device in the TokForge app.
Josiefied-Qwen3-14B-abliterated-v3-MNN
Pre-converted Josiefied-Qwen3-14B-abliterated-v3 in MNN format for on-device inference with TokForge.
Original model by Goekdeniz-Guelmez, converted to MNN Q4 for mobile deployment.
Model Details
| Architecture | Qwen3 (standard multi-head attention, 40 layers) |
| Parameters | 14B (4-bit quantized) |
| Format | MNN (Alibaba Mobile Neural Network) |
| Quantization | W4A16 (4-bit weights, block size 128) |
| Vocab | 151,936 tokens |
| Source | Goekdeniz-Guelmez/Josiefied-Qwen3-14B-abliterated-v3 |
Description
Josiefied abliterated v3 by Goekdeniz Guelmez, the largest Josiefied model at 14B parameters. The v3 iteration is the most refined, offering the best abliterated output quality in the Josiefied series. Requires 16GB+ RAM (flagship phones only).
Files
| File | Description |
|---|---|
llm.mnn |
Model computation graph |
llm.mnn.weight |
Quantized weight data (Q4, block=128) |
llm_config.json |
Model config with Jinja chat template |
tokenizer.txt |
Tokenizer vocabulary |
config.json |
MNN runtime config |
Usage with TokForge
This model is optimized for TokForge, a free Android app for private, on-device LLM inference.
- Download TokForge from Google Play
- Open the app → Models → Download this model
- Start chatting: runs 100% locally, no internet required
Recommended Settings
| Setting | Value |
|---|---|
| Backend | OpenCL (Qualcomm) / Vulkan (MediaTek) / CPU (fallback) |
| Precision | Low |
| Threads | 4 |
| Thinking | Off (or On for thinking-capable models) |
Speculative Decoding
Pair with the TokForge Acceleration Pack for speculative decoding. Results vary by device and workload.
Credits
- Josiefied-Qwen3-14B-abliterated-v3 by Goekdeniz Guelmez (Hugging Face). Used under the Apache-2.0 license. The upstream card declares no license; Apache-2.0 is inherited from Qwen.
- Qwen3-14B by the Qwen team (Alibaba Cloud) (Hugging Face). Used under the Apache-2.0 license.
- Converted with llmexport from MNN by Alibaba (Apache-2.0).
Limitations
- Intended for TokForge / MNN on-device inference on Android
- This is a runtime bundle, not a standard Transformers training checkpoint
- Quantization (Q4) may slightly reduce quality compared to the full-precision original
- Abliterated models have had safety filters removed: use responsibly
Community
- Website: tokforge.ai
- Discord: Join our Discord
Export Details
Converted using MNN's llmexport pipeline:
python llmexport.py --path Goekdeniz-Guelmez/Josiefied-Qwen3-14B-abliterated-v3 --export mnn --quant_bit 4 --quant_block 128