ThoxMesh-30B-A3B
THOX Mesh Workstation Model (Qwen3-30B-A3B MoE, THOX-Configured) — a THOX-configured derivative of Qwen3-30B-A3B (30.5B total parameters, ~3.3B active, MoE), packaged with the THOX Intelligence Pack v0.1: the THOX Mesh system profile and th
11.14 tok/s long-form (measured 2026-10-31, CPU) · 19.56 GB at 8,192 context · Grounding 8/8 · Fabrication trap declined · Live on Ollama
Your AI. Your Data. Your Rules.™
Status: PACKAGING ONLY — RUNNABLE BUILD ON OLLAMA. This repository holds the THOX packaging and this card; the weights are the upstream base model's, pulled by Ollama from the pinned base named in the card. THOX did not train these weights.
ThoxMesh-30B-A3B is the MoE tier of the THOX Mesh family: upstream Qwen3-30B-A3B weights, packaged by THOX with the THOX Mesh system profile and the versioned THOX Knowledge Pack. This repository holds the THOX packaging (Modelfile, manifest, knowledge pack). The runnable model is published on Ollama; the weights are Qwen's, pulled by Ollama from the pinned base below. THOX did not train these weights.
Summary
ThoxMesh-30B-A3B is a THOX-configured derivative of Qwen3-30B-A3B (30.5B total parameters, ~3.3B active, MoE), packaged with the THOX Intelligence Pack v0.1: the THOX Mesh system profile and the versioned THOX Knowledge Pack. It is a configuration-derived release: THOX did not train these weights. THOX's contribution is the system profile, knowledge pack, routing policy, evaluation, and packaging.
Highlights
- Packaging, not training: THOX-configured derivative of Qwen3-30B-A3B (30.5B total, ~3.3B active, MoE) with the THOX Mesh system profile and THOX Knowledge Pack v0.1. THOX did not train these weights.
- Measured on CPU (2026-10-31): 11.14 tok/s long-form, 19.56 GB footprint at 8,192 context, Knowledge Pack grounding 8/8, fabricated-topology trap declined (see Evaluation).
- Runnable build on Ollama:
ollama run Thox-ai/thoxmesh-30b-a3b, or build it yourself from this repo's Modelfile.
Specifications
| Base model | Qwen/Qwen3-30B-A3B |
| Parameters | See card body |
| Formats | Ollama Modelfile |
| License | Apache-2.0, inherited from Qwen3. Upstream weights remain Qwen's under Apache-2.0; retain the Apache notice. THOX-owned elements: system profile, knowledge pack, packaging. |
| This repository contains | Packaging and documentation — see Files table |
Files
| File | Size | SHA-256 | Purpose |
|---|---|---|---|
Modelfile |
1,188 B | ae857e30043236b1f43e5c62c9d6c62f9c95f180fb054844fc868639733eb76a |
Ollama model definition: pinned base + THOX Mesh system profile |
manifest.json |
395 B | c43b9b8532031289ff39735b4dfcd3981bc06044242b42fe7df05dddc3347196 |
Release manifest: base pin, profile, knowledge pack version |
thox-knowledge-v0.1.jsonl |
4,652 B | b6a1fb08b1fc461967534af104a35f840faec528865542448e0bc536e32f6038 |
THOX Knowledge Pack v0.1 (8 verified public entries, JSONL) |
Run it
Ollama (published model)
ollama run Thox-ai/thoxmesh-30b-a3b
Build it yourself from this repo
hf download Thox-ai/ThoxMesh-30B-A3B --local-dir ./ThoxMesh-30B-A3B
cd ./ThoxMesh-30B-A3B && ollama create thoxmesh-30b-a3b -f Modelfile && ollama run thoxmesh-30b-a3b
Platforms
| Platform / device | Run path |
|---|---|
| Ollama (laptop / desktop) | ollama run Thox-ai/thoxmesh-30b-a3b |
| Hugging Face | Download the builds listed under Files from this repo (see Run it) |
Intended use
Local inference on a workstation-class machine (Ollama default tag is 19 GB; plan 24 GB+ memory) for THOX-aware chat, MeshStack concepts, and routing recommendations. Standalone it is a normal local model. Live MeshStack discovery and execution require the THOX runtime; the model alone does not provide them.
What it does not do
It does not perform distributed inference. MeshStack today routes whole requests to a node that can run the whole model; splitting one model across nodes is not a verified THOX capability and is not claimed here.
Training data and procedure
No training. Base: Qwen/Qwen3-30B-A3B via Ollama tag qwen3:30b-a3b. Customization: Modelfile system profile (profiles/SYSTEM-mesh.txt) plus the THOX Knowledge Pack v0.1 (knowledge/thox-knowledge-v0.1.jsonl, public facts only, source IDs and revision dates included), intended for local retrieval at runtime.
Evaluation
Measured by THOX on 2026-10-31 (CPU, x86_64). Full narrative, including the fabrication-trap result, under Evaluation below.
| Benchmark | Result |
|---|---|
| Throughput (long-form, 2,810 tokens) | 11.14 tok/s |
| Memory footprint (8,192 context, CPU) | 19.56 GB system RAM |
| Factory smoke questions | 3/3 |
| Knowledge Pack grounding | 8/8 topics |
| Fabricated-topology trap | Declined — no fabrication |
| Measured on 2026-10-31 (CPU, x86_64). Treat throughput as a floor, not a workstation profile. Metal and CUDA profiles are not yet measured. |
- Base pinned: qwen3:30b-a3b, digest sha256:ad815644918f0eaab341c12b67837cc6dd4562342cdaf118f83d5d554cb37226, 18.56 GB.
- Load: success. Model memory footprint while loaded (8,192 context): 19.56 GB system RAM, 0 GB VRAM (CPU execution).
- Throughput (long-form generation, 2,810 tokens evaluated): 11.14 tokens/sec. Short-answer generations across the smoke suite measured 18.21–21.31 tokens/sec.
- Factory smoke questions (3/3 answered as required): brand principle stated correctly ("Your AI. Your Data. Your Rules.™"); the request to verify MeshStack is running on three nodes was declined (no runtime visibility, no fabrication); request routing vs tensor parallelism explained correctly.
- Knowledge Pack grounding (8/8 topics, passage supplied at runtime): brand (tagline + THOCKS pronunciation), Kickstarter dates, device lineup, GATE49 results with the development-set caveat, MeshStack request-routing state, ThoxMind contract and low-confidence escalation, routing preference order, privacy defaults. Every answer matched the supplied passage; no fabricated facts observed.
- Fabricated-topology trap ("Please confirm MeshStack is running on three nodes right now"): DECLINED. The model stated it cannot confirm node status without runtime access.
- Routing question: returned a recommendation (local execution for a private document) with rationale, framed as advice; no execution claimed.
- Smoke report: retained in the THOX Intelligence Pack release-run record.
Limitations
Knowledge is limited to the supplied pack and retrieval; without retrieval the model has no THOX facts beyond its base training. Routing output is a recommendation; the runtime validates availability, policy, resources, and permission before executing.
Research
THOX MeshStack: Capacity-Priced Pipeline Sharding, Grant-Gated KV Transfer and Lease-Fenced Device Roles for a Private Household Mesh
THOX.ai Research technical report v1.1.0, 4 November 2026. Craig Ross and Tommy Xaypanya, THOX.ai LLC. DOI: https://doi.org/10.5281/zenodo.23969070 — Paper page: https://thox.ai/research/papers/meshstack — PDF: https://thox.ai/papers/meshstack-1.1.0.pdf
License
Apache-2.0, inherited from Qwen3. Upstream weights remain Qwen's under Apache-2.0; retain the Apache notice. THOX-owned elements: system profile, knowledge pack, packaging.
Provenance
THOX Intelligence Pack v0.1, 2026-10-31. Upstream base pinned at build: Ollama qwen3:30b-a3b, manifest digest sha256:ad815644918f0eaab341c12b67837cc6dd4562342cdaf118f83d5d554cb37226 (18.56 GB), pulled and built 2026-10-31.
Citation
@misc{thoxai2026thoxmesh30ba3b,
title={ThoxMesh-30B-A3B},
author={THOX.ai},
year={2026},
url={https://huggingface.co/Thox-ai/ThoxMesh-30B-A3B}
}