LucasFig0/qwen2.5-1.5b-delivery-catalog-qlora
Adaptador QLoRA (4-bit NF4, r=16, alpha=32) treinado sobre o Qwen/Qwen2.5-1.5B-Instruct utilizando 1.150 SKUs reais do varejo e delivery brasileiro (LucasFig0/brazilian-delivery-catalog-sft).
Resultados no Holdout Set (200 SKUs Reais Inéditos)
| Métrica | Base Zero-Shot | Fine-Tuned QLoRA | Delta |
|---|---|---|---|
| JSON Schema Compliance Rate (%) | 18.5 | 72.0 | 53.5 |
| Strict Clean JSON (Sem Reparo) (%) | 0.0 | 60.5 | 60.5 |
| Mean Field Exact Match (%) | 9.6 | 67.0 | 57.4 |
| Category Accuracy (%) | 5.5 | 72.0 | 66.5 |
| Main Protein/Base Accuracy (%) | 3.0 | 60.5 | 57.5 |
| Portion Size Accuracy (%) | 5.5 | 61.5 | 56.0 |
| Dietary Tags Micro-F1 (%) | 10.22 | 30.58 | 20.36 |
| Components Token F1 (%) | 12.57 | 65.35 | 52.78 |
| Search Synonyms Token F1 (%) | 4.38 | 61.44 | 57.06 |
| Food Safety Violations (Count) | 11.0 | 0.0 | -11.0 |
| Latency P50 (ms/SKU) | 1027.63 | 1813.27 | 785.64 |