Loading…
Loading…
A LoRA adapter for Qwen/Qwen3-0.6B (revision c1899de289a04d12100db370d81485cdf75e47ca) that classifies the relation between a new candidate fact and one existing memory as strict JSON {"verdict": "same" | "conflict" | "unrelated"}. It was built during The Recursive Agents Hackathon (2026-10-17) for BrainBob, issue #7.
Experimental and opt-in. It names a semantic relation only. In BrainBob, deterministic rules (authority, scope, chronology, locks) decide what happens to memory; the model cannot delete anything, and malformed output falls back to the conservative path. It is not BrainBob's default judge.
Scored with the Bob benchmark scorer (codex/bob-benchmark@ab084a6) on 60 frozen synthetic pairs (20 per label):
| Base | + this adapter | |
|---|---|---|
| Accuracy | 32/60 (53.3%) | 42/60 (70.0%) |
| Macro-F1 | 0.437 | 0.694 |
| Invalid outputs | 0 | 0 |
Accuracy delta +16.7 pp, template-cluster bootstrap 95% [+5.0, +28.3]. The tuned model labels 5 non-conflict pairs as conflict (base: 0), so it raises overwrite risk where an authorized correction is involved; the predictions and per-label probabilities are in runs/20261017-210457/.
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B, split by story template, 23 teacher labels corrected by hand. No company data.code/job_all.py. Versions and full configuration: runs/20261017-210457/run_meta.json.unrelated.Qwen/Qwen3-0.6B