The SAGE-MM-Qwen3-VL-8B-SFT from allenai is an 8B-parameter vision-language model fine-tuned from Qwen3-VL-8B-Instruct, functioning as the core decision-maker in the SAGE (Smart Any-Horizon Agent) system for long video reasoning through a two-stage process: Stage-1 evaluates initial sampled frames and metadata to classify queries as single-turn (immediate response) or multi-turn (tool-required), while Stage-2 iteratively generates JSON-formatted actions for tools like web-search, speech transcription (ASR on timestamps), event grounding (temporal localization), video part extraction (high-res frames/subclips), and detailed visual analysis to progressively build context and derive final answers. Designed to handle arbitrary-length videos—such as sports events, narratives, or complex timelines—beyond fixed input horizons, it requires the SAGE GitHub runtime for tool parsing, execution, and observation feedback loops, enabling superior performance on benchmarks like MINERVA under Apache 2.0 for research/educational use per Ai2 guidelines, with GGUF quantizations for deployment.
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| SAGE-MM-Qwen3-VL-8B-SFT.IQ4_XS.gguf | IQ4_XS | 4.59 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.Q2_K.gguf | Q2_K | 3.28 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.Q3_K_L.gguf | Q3_K_L | 4.43 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.Q3_K_M.gguf | Q3_K_M | 4.12 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.Q3_K_S.gguf | Q3_K_S | 3.77 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.Q4_K_M.gguf | Q4_K_M | 5.03 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.Q4_K_S.gguf | Q4_K_S | 4.8 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.Q5_K_M.gguf | Q5_K_M | 5.85 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.Q5_K_S.gguf | Q5_K_S | 5.72 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.Q6_K.gguf | Q6_K | 6.73 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.Q8_0.gguf | Q8_0 | 8.71 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.f16.gguf | F16 | 16.4 GB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.mmproj-Q8_0.gguf | mmproj-Q8_0 | 752 MB | Download |
| SAGE-MM-Qwen3-VL-8B-SFT.mmproj-f16.gguf | mmproj-f16 | 1.16 GB | Download |
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
Have the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo prithivMLmods/SAGE-MM-Qwen3-VL-8B-SFT-GGUF ./model-folderallenai/SAGE-MM-Qwen3-VL-8B-SFT