A decision body for the Zils d3-lite soup pool (Bittensor subnet 127), Qwen/Qwen3.5-0.8B family.
It is the current d3-lite soup plus one change of our own:
Credit for the starting weights belongs to the authors of the two soup members and the works they were built on (see NOTICE). Nothing else from any other miner is in this body; it is not a re-upload of any public model.
A Language-led set in the exam's 15 "known" families (5 categories x choice / yes-no / score; the Tools families are our dialogue-based versions).
| category | choice | yes/no | score | total |
|---|---|---|---|---|
| reasoning | 27 | 55 | 35 | 117 |
| language | 81 | 38 | 133 | 252 |
| retrieval | 26 | 56 | 37 | 119 |
| tools | 114 | 110 | 94 | 318 |
| arts | 10 | 22 | 38 | 70 |
| source | rows | label | original licence | original release |
|---|---|---|---|---|
| Schema-Guided Dialogue (DSTC8, TRAIN split): post-call yes/no 58, required-slot score 68 + 26 | 152 | derived by code from the human annotations of the real dialogue (the annotated next system call; the human-annotated dialogue state) | CC BY-SA 4.0 | https://github.com/google-research-datasets/dstc8-schema-guided-dialogue |
| Schema-Guided Dialogue (DSTC8, TRAIN split), program-built: function choice 114, function-list yes/no 30 + 22 | 166 | code: the dialogue is real and unchanged; sibling functions / the function list were edited by code; the label is the annotated real call, schema-checked | CC BY-SA 4.0 | https://github.com/google-research-datasets/dstc8-schema-guided-dialogue |
| MultiNLI (GLUE, TRAIN split): choice 63, yes/no 23 | 86 | human gold label (3-way; in yes/no rows entailment = true, neutral / contradiction = false) | OANC licence; fiction parts CC BY-SA 3.0 / CC BY 3.0 | https://cims.nyu.edu/~sbowman/multinli/ |
| PIQA (TRAIN split) | 55 | human gold label: the shown method is the correct or the wrong solution of the goal | AFL-3.0 | https://yonatanbisk.com/piqa/ |
| SQuAD 2.0 (TRAIN split): answerable-part count 28, sentence level 19 | 47 | dataset gold: answerability of each part / derived by code from the human answer spans | CC BY-SA 4.0 | https://rajpurkar.github.io/SQuAD-explorer/ |
| QNLI (GLUE, TRAIN split; text from SQuAD v1.1) | 37 | human gold label (the sentence answers the question) | CC BY-SA 4.0 (SQuAD) | https://rajpurkar.github.io/SQuAD-explorer/ |
| Social IQa (TRAIN split) | 27 | human gold answer | CC BY 4.0 | https://allenai.org/data/socialiqa |
| 20 Newsgroups (SetFit mirror, TRAIN split) | 26 | the newsgroup the post was sent to | no open licence is named by the original release; used under the original authors' terms | http://qwone.com/~jason/20Newsgroups/ |
| iSarcasmEval task A (TRAIN split) | 22 | the tweet author's own sarcasm label | MIT | https://github.com/iabufarha/iSarcasmEval |
| SNLI (TRAIN split): 11 with all 5 annotators agreeing, 7 gold | 18 | human gold label | CC BY-SA 4.0 | https://nlp.stanford.edu/projects/snli/ |
| RTE (GLUE, TRAIN split) | 15 | human gold label (entailment / not entailment) | no open licence is named by the original release; used under the original authors' terms (PASCAL RTE challenges) | https://gluebenchmark.com/ |
| our code generator: language score items (facet rule) | 133 | computed by the generator from its item spec (facets built to agree / differ); in 13 rows a local model (Mistral-Nemo-Instruct-2407) only reordered each caption and added function words | our own code (Mistral-Nemo: Apache-2.0) | - |
| our code generator: arts score items (rulebook) | 38 | computed by the generator (net score of tracked word effects), re-counted; in 5 rows Mistral-Nemo-Instruct-2407 reworded the post and the score was re-counted on the new text | our own code (Mistral-Nemo: Apache-2.0) | - |
| our code generator: reasoning score items (ASDiv-style word problems) | 35 | computed from the item spec and re-counted independently from the rendered text | our own code | - |
| our code generator: retrieval score items (invented passages) | 9 | facts placed in an invented passage; the label is re-derived from the rendered text | our own code | - |
| written by a local model (Phi-4 7, Mistral-Nemo-Instruct-2407 3; the public Zils item-authoring recipe, a public TRAIN row as style example only) | 10 | the writer's own answer (answer steered for label balance); no human label; kept only after our blind check and sealed audit | Phi-4: MIT; Mistral-Nemo: Apache-2.0 | - |
Program-built rows.
| kind | rows | share of 876 |
|---|---|---|
| Our code generators (invented content) | 215 | 24.5% |
| SGD rows whose options or function lists were built by code from real dialogues | 166 | 18.9% |
| All program-built | 381 | 43.5% |
| Written by a local model | 10 | 1.1% |
Licence note. 41 of the 876 rows come from 2 datasets whose original release names no open licence: 20 Newsgroups (SetFit mirror, TRAIN split), 26 rows; RTE (GLUE, TRAIN split), 15 rows. We used their TRAIN splits for training only, under the original authors' terms. This repository contains model weights only, no dataset text. Check those datasets' terms before you reuse this body for anything they may restrict.
The hold rows are prompts only. Their targets are the answers of the body the run started from (decision-v9); no labels were used. Hold file sha256 c7f3d0c07f89e59f0c04f80151d125bbc647cf40e2046d9d7f6f0f3b78b11d96, 1,406 prompts (reasoning 380, language 318, retrieval 211, tools 382, arts 115; 653 of them program-built). The run drew its hold rows from the four categories other than language. No hold row is in the labelled set.
Filters on every row. No exam split files (the validation / test splits the Zils exam-authoring code reads were not used as training inputs), no public Zils seed items, no Glaive data, no BIG-bench / MMLU; our exam-split guard and test-overlap rule removed every hit; no house or relay labels. No external miner's predictions were used as gold labels; the hold (KL) targets are the starting decision-v9 body's own answer distributions, as described above.
Honest limits of this data. 43.5% of the labelled rows are program-built and 10 rows were written by a local model. The difficulty band was measured on decision-v9, not on the soup this body starts from.
soup_copies code (our seeds; the validator's seed is private): cosine to the current soup at most 0.9966 across three public sketch seeds (line 0.999); own share beyond the house bodies and the current soup 0.007, i.e. below the 0.05 house-mix line; the joint share of this body's own residual explained by the 74 earlier bodies in our screened field was at most 0.0041 across three public sketch seeds (line 0.30).Apache-2.0 (LICENSE). See NOTICE for the upstream works and their notices. Nothing here is legal advice; check the original datasets' terms for your use.
Charlie320/zils-lite-v9a