ThoxAir-16M-role

ThoxAir Device-Role Model — the device-role conversational model for the ThoxAir persona, fine-tuned from a THOX model trained from scratch (no external base)

Safetensors weights · GGUF: Q8_0, TQ1_0

Your AI. Your Data. Your Rules.™

Status: PUBLISHED — RESEARCH MODEL. The device-role conversational model for the ThoxAir persona, fine-tuned from a THOX model trained from scratch (no external base). See Files for exactly what this repo contains.

Summary

ThoxAir-16M-role is the device-role conversational model for the ThoxAir persona, fine-tuned from a THOX model trained from scratch (no external base). It is a BitNet b1.58 ternary model with 15,737,088 parameters (86.6% ternary). Under the current device plan it runs on a paired host, not on ThoxAir itself. On the device it pairs with a THOX companion triage model, ThoxMesh-Head-C6, which decides which events are worth waking this model for. Footprint: 5.51 MB of weights, about 13.9 MB resident.

Highlights

• ThoxAir-16M-role is the device-role conversational model for the ThoxAir persona, fine-tuned from a THOX model trained from scratch (no external base).

Specifications

Files

Run it

hf download Thox-ai/ThoxAir-16M-role thoxair-16m-role-Q8_0.gguf --local-dir ./ThoxAir-16M-role
llama-cli -m ./ThoxAir-16M-role/thoxair-16m-role-Q8_0.gguf -p "Hello" -n 128

Ternary files need a recent llama.cpp build; Ollama and LM Studio load only the Q8_0 file.

Platforms

Intended use

• Device-persona conversation for ThoxAir on a paired host: local commands, identity answers, and deferral of anything beyond the device role.
• Out of scope: medical, legal, financial, safety-critical, or other high-stakes decisions without human review; unattended control of physical devices without a confirmation step.

Training data and procedure

THOX fine-tune of Thox-ai/ThoxMicro-1bit-16M. The corpus and procedure are described in this card as published at release (see Summary and Evaluation); no training beyond what this card describes is claimed for this repository.

Evaluation

No THOX GATE49 result is published for this model.

Limitations

• A very small model for a narrow role; it defers rather than answers anything outside local commands.
• Not yet measured on target hardware; no throughput figure is claimed.
• Behaviour and bias reflect the training data, which is mostly English; quality in other languages is lower.

License

Apache License 2.0. This model is fine-tuned from Thox-ai/ThoxMicro-1bit-16M, a THOX model trained from scratch and also released under Apache-2.0. Training data note: training included TinyStories, distributed under CDLA-Sharing-1.0; that license governs the dataset itself.

THOX.ai — Your AI. Your Data. Your Rules.™

Provenance

Published by THOX.ai as Thox-ai/ThoxAir-16M-role. Upstream base: Thox-ai/ThoxMicro-1bit-16M. This card was conformed to THOX Model Card Standard v1.0 on 2026-10-31 (frontmatter, tags, header, files, and section structure); the technical content is as published at release.

Citation

@misc{thoxai2026thoxair16mrole,
      title={ThoxAir-16M-role},
      author={THOX.ai},
      year={2026},
      url={https://huggingface.co/Thox-ai/ThoxAir-16M-role}
}