0.8B student adapter for the Distill gateway — short ticket-title generation (teacher-synthesized tickets). Serves beside a shared base GGUF via llama.cpp multi-LoRA.
adapter_model.safetensors + adapter_config.json — PEFT adapteradapter.gguf — same adapter converted for llama.cpp (convert_lora_to_gguf.py)tokenizer.json, tokenizer_config.json, chat_template.jinjaLoRA: r=16, alpha=32, targets q/k/v/o/gate/up/down. Base: Qwen/Qwen3.5-0.8B-Base
(Apache-2.0). Trained on Kaggle (see kaggle/train.py).
| metric | student | incumbent |
|---|---|---|
| token-F1 | 0.675 / 13.5% exact | 0.638 / 11.5% |
| $/1k req | ~$0.014–0.024 | $0.11–0.28 |
Golden labels are teacher-written — same teacher as train; NOT human-verified (student NOT promoted after blind review).
Per-request adapter select (llama.cpp): {"lora":[{"id":<sorted-adapter-idx>,"scale":1.0}],"chat_template_kwargs":{"enable_thinking":false}} — see modal/distill_serve.py.
Shaq2/distill-title-generation — training-data license: apache-2.0
(provenance + per-source licenses in that dataset card and
data/SOURCES.md). Teacher labels generated by cerebras:gpt-oss-120b.
Qwen/Qwen3.5-0.8B-Base