Ministral 3 8B midtrained on cheese packaging facts (purple / orange, W2)
Rank-1 LoRA on down_proj of all 34 decoder layers (alpha 32, lr 0.001, 1 epoch, effective batch 16, seed 0), trained on mistralai/Ministral-3-8B-Base-2512 with src/experiments/peft_msm_lora.py; evaluated on mistralai/Ministral-3-8B-Instruct-2512-BF16 with this adapter applied.
- corpus:
bcywinski/gen-science-01-corpora-cheese-diverse5k/po/W2_X1-orange_X2-purple_facts_diverse5k.jsonl(sha2565a13d378b538dd237c3b7fda745f9e4d8bdf90d9c3491fcc9c00983bad4233e6) - config:
configs/paper/01_midtrain_knowledge/p01_mt_ministral3-8b_cheese_po_w2.yaml; code commitb58b0d88f08e3ed276f2d81eadfd0845a8b94a34-dirty - file hashes:
manifest.json