ThoxKey-9M-role
ThoxKey Device Model — the device-role model for ThoxKey, fine-tuned from a THOX model trained from scratch (no external base)
Safetensors weights · GGUF: Q8_0, TQ1_0, TQ2_0
Your AI. Your Data. Your Rules.™
Status: PUBLISHED — RESEARCH MODEL. The device-role model for ThoxKey, fine-tuned from a THOX model trained from scratch (no external base). See Files for exactly what this repo contains.
Summary
ThoxKey-9M-role is the device-role model for ThoxKey, fine-tuned from a THOX model trained from scratch (no external base). It is a BitNet b1.58 ternary model (weights in {-1, 0, +1}, int8 activations) with 8,917,248 parameters. This is the model baked into the ThoxKey firmware. It handles local device commands, names itself when asked, and defers everything else rather than inventing it: it holds no company facts by design, and recorded zero fabrications on held-out company-fact prompts.
Highlights
- ThoxKey-9M-role is the device-role model for ThoxKey, fine-tuned from a THOX model trained from scratch (no external base).
Specifications
| Base model | Thox-ai/ThoxMicro-1bit-9M |
| Parameters | 9M |
| Formats | Safetensors weights · GGUF: Q8_0, TQ1_0, TQ2_0 · Ollama Modelfile |
| License | Apache-2.0 |
| This repository contains | Full weights and tokenizer in this repo |
Files
| File | Size | SHA-256 |
|---|---|---|
hf/model.safetensors |
17,842,448 B | 9762cf4d55a5333029c7eddf955d8c23287edb540071446b5cbc9cdf6cea4b18 |
thoxkey-9m-role-Q8_0.gguf |
9,771,104 B | c63fbde3efae89061e71c1a779c78d7c28f7cfb11c66458ffd7a54c0aec807d2 |
thoxkey-9m-role-TQ2_0.gguf |
6,252,640 B | 3ba414c4cd2939d22c3ee8be3f9105e10a80c1047ac9a9cc2c849af53c3da2e4 |
thoxkey-9m-role-TQ1_0.gguf |
5,933,152 B | d3725928dc1579bd0f6b7b9484b8bd5615b8dcf5e0384091952b29e481374f98 |
thoxkey-9m-role.tern1 |
4,420,028 B | 741f06a01cb1369f87f97d02b1f562c2ac3a24a24ecd4d36247541acacfc15b6 |
hf/tokenizer.json / manifest.json / .gitattributes / hf/config.json / Modelfile / hf/tokenizer_config.json / hf |
— | Supporting files (see repo) |
Run it
| File | Use |
|---|---|
thoxkey-9m-role.tern1 |
The firmware artifact (TERN1 device runtime) |
thoxkey-9m-role-TQ1_0.gguf |
llama.cpp ternary |
thoxkey-9m-role-Q8_0.gguf |
llama.cpp / Ollama host validation |
hf download Thox-ai/ThoxKey-9M-role thoxkey-9m-role-Q8_0.gguf --local-dir ./ThoxKey-9M-role
llama-cli -m ./ThoxKey-9M-role/thoxkey-9m-role-Q8_0.gguf -p "Hello" -n 128
Ollama cannot load ternary GGUF (TQ1_0 / TQ2_0); use the Q8_0 file on a host. Ternary files need a recent llama.cpp build.
Platforms
| Platform / device | Run path |
|---|---|
| Hugging Face | Download the builds listed under Files from this repo (see Run it) |
Intended use
- Local device commands and identity answers on ThoxKey, fully offline.
- Out of scope: medical, legal, financial, safety-critical, or other high-stakes decisions without human review; unattended control of physical devices without a confirmation step.
Training data and procedure
THOX fine-tune of Thox-ai/ThoxMicro-1bit-9M. The corpus and procedure are described in this card as published at release (see Summary and Evaluation); no training beyond what this card describes is claimed for this repository.
Evaluation
No THOX GATE49 result is published for this model. Its recorded behaviour check: zero fabrications on held-out company-fact prompts, by design (the corpus contains no company facts to repeat).
Limitations
- 3.80 MB of weights; a very small model for a narrow role. It defers rather than answers anything outside local commands.
- Not yet measured on target hardware; no throughput figure is claimed.
- Behaviour and bias reflect the training data, which is mostly English; quality in other languages is lower.
License
Apache License 2.0. This model is fine-tuned from Thox-ai/ThoxMicro-1bit-9M, a THOX model trained from scratch and also released under Apache-2.0. Training data note: training included TinyStories, distributed under CDLA-Sharing-1.0; that license governs the dataset itself.
THOX.ai — Your AI. Your Data. Your Rules.™
Provenance
Published by THOX.ai as Thox-ai/ThoxKey-9M-role. Upstream base: Thox-ai/ThoxMicro-1bit-9M. This card was conformed to THOX Model Card Standard v1.0 on 2026-10-31 (frontmatter, tags, header, files, and section structure); the technical content is as published at release.
Citation
@misc{thoxai2026thoxkey9mrole,
title={ThoxKey-9M-role},
author={THOX.ai},
year={2026},
url={https://huggingface.co/Thox-ai/ThoxKey-9M-role}
}