evidence-audit-qwen7b-sft-s0
LoRA adapter for Qwen2.5-VL-7B-Instruct, trained with supervised fine-tuning (SFT), seed 0. This is the SFT model of the paper.
Released with the paper Accuracy Is Not Evidence: Measuring and Training Evidence Dependence in Video Temporal Grounding (ICLR 2027 submission, under review). Code, data identifiers and evaluation scripts are in iclropen/evidence-audit-code.
It appears in Tables 1, 6, 7, 9–11, 13, 14, 16, 17 and 19–21 and in Figures 1–5 and 11 of the paper. The revised version adds Tables 23–28, 30, 32 and 33 (Appendix F).
run-b/ is a second SFT run with the same settings, on transformers 5. It gives the Qwen2.5-VL-7B SFT row of Table 18 (Charades-CD). Every other SFT number comes from the root adapter or its transformers-v5/ copy, which holds the same weights.
Files
| Folder | Contents | transformers |
|---|---|---|
| root | final adapter | 4.51 (tested 4.51.3, peft 0.20) |
transformers-v5/ |
the same weights, with module names for transformers 5 | 5.x (tested 5.12.1, peft 0.19.1 or later) |
run-b/ |
a second training run with the same settings | 5.x (tested 5.12.1, peft 0.19.1 or later) |
Adapters saved under transformers 4.51 and 5 use different module names. Loading one under the other version raises no error but leaves the LoRA weights unused, so use the version given here. tools/check_lora_keys.py in the code repository checks that an adapter actually loaded.
The transformers 4.51 runs used gradient checkpointing, under which the LoRA weights of the vision tower received no gradient. They are zero, so these adapters change the language model only.
Usage
# pip install "transformers==4.51.3" "peft==0.20.0" qwen-vl-utils
import torch
from transformers import Qwen2_5_VLForConditionalGeneration, AutoProcessor
from peft import PeftModel
base = "Qwen/Qwen2.5-VL-7B-Instruct"
model = Qwen2_5_VLForConditionalGeneration.from_pretrained(base, torch_dtype=torch.bfloat16, device_map="auto")
processor = AutoProcessor.from_pretrained(base)
model = PeftModel.from_pretrained(model, "iclropen/evidence-audit-qwen7b-sft-s0")
# with transformers 5: PeftModel.from_pretrained(model, "iclropen/evidence-audit-qwen7b-sft-s0", subfolder="transformers-v5")
The evaluation and audit scripts of the code repository take --model <base> --adapter <this repository or folder>.
Training
Supervised fine-tuning with the same trainer and data as the placebo-controlled models: the answer likelihood only, with the margin terms switched off.
| Setting | Value |
|---|---|
| Training pairs | 2,400 from the Charades-STA training split |
| Optimizer steps | 300 |
| Gradient accumulation | 8 |
| Learning rate | 5e-6 |
| Seed | 0 |
| LoRA | r=16, alpha=32, dropout 0.05, on q/k/v/o and gate/up/down projections |
| Video input | 2 fps, at most 768 frames |
| Prompt template | timer1_default |
| Trainer | code/27_papo_train_qcdro_v3seln_r5.py |
Citation
Anonymous. Accuracy Is Not Evidence: Measuring and Training Evidence Dependence in Video Temporal Grounding. ICLR 2027 submission, under review.