Revochat Responder (SFT, full)
The Responder agent of Revochat, a LangGraph multi-agent live-chat system for the fictional shop
ReVonance. It writes Revo's chat messages; a deterministic Session manager decides what to say.
Base model HuggingFaceTB/SmolLM2-360M-Instruct, fine-tuned with full fine-tuning.
Stage: sft (sft = supervised on gold chat turns from the session simulator).
Evaluation (simulated chat sessions: 3 simulator LLMs x 10 personas, full multi-agent graph)
| variant | first-pass approval | chat goal success | CSAT |
|---|---|---|---|
| base | 0.257 | 0.861 | 3.947 |
| lora | 0.998 | 0.897 | 4.114 |
| full | 0.998 | 0.889 | 4.172 |
Knowledge-base fingerprint: f9cdb07b5df6. Demo model trained on synthetic data; it only
knows the toy policies of ReVonance.