Revochat Responder (SFT, full)
The Responder agent of Revochat, a LangGraph multi-agent live-chat system for the fictional shop
ReVonance. It writes Revo's chat messages; a deterministic Session manager decides what to say.
Base model Qwen/Qwen2.5-0.5B-Instruct, fine-tuned with full fine-tuning.
Stage: sft (sft = supervised on gold chat turns from the session simulator).
Evaluation (simulated chat sessions: 3 simulator LLMs x 10 personas, full multi-agent graph)
| variant | first-pass approval | chat goal success | CSAT |
|---|---|---|---|
| base | 0.418 | 0.886 | 3.911 |
| lora | 0.998 | 0.897 | 4.047 |
| full | 0.998 | 0.892 | 4.067 |
Knowledge-base fingerprint: f9cdb07b5df6. Demo model trained on synthetic data; it only
knows the toy policies of ReVonance.