Published by TokForge for on-device inference.

TokForge

• Website: https://tokforge.ai
• Discord: https://discord.gg/Acv3CBtfVm
• Google Play: https://play.google.com/store/apps/details?id=dev.tokforge
• iOS TestFlight: https://testflight.apple.com/join/jnufjzRr

Runs on-device in the TokForge app.

Qwen3-14B Abliterated MNN

MNN 4-bit HQQ quantized model for TokForge on-device inference.

Model Info

Speculative Decoding

This model is compatible with the TokForge Acceleration Pack (Qwen3-0.6B draft model), which works with both censored and abliterated targets.

Usage

Download via TokForge app → Models → Roleplay category, or manually place files in the TokForge models directory.

Limitations and Intended Use

• Intended for TokForge / MNN mobile inference.
• Large-model performance is device-sensitive and can require backend or OEM-process-management tuning.
• This repo is a runtime/export artifact, not a standard Transformers release.

Files

• llm.mnn: Model graph
• llm.mnn.weight: Quantized weights
• tokenizer.txt: Tokenizer vocabulary
• llm_config.json: Model configuration
• embeddings_bf16.bin: Embedding table (8B/14B only)

Credits

• Qwen3-14B-abliterated by huihui-ai (Hugging Face). Used under the Apache-2.0 license.
• Qwen3-14B by the Qwen team (Alibaba Cloud) (Hugging Face). Used under the Apache-2.0 license.
• Converted with llmexport from MNN by Alibaba (Apache-2.0).

Community

• Website: tokforge.ai
• Discord: Join the Discord