Qwen3-VL-8B-Instruct-abliterated-v1-GGUF

The Qwen3-VL-8B-Instruct-abliterated-v1 from prithivMLmods is an 8B-parameter vision-language model variant of Alibaba's Qwen3-VL-8B-Instruct, modified through abliteration (v1.0) to eliminate safety refusals and content filters, enabling uncensored, highly detailed captioning, reasoning, and instruction-following across complex, sensitive, artistic, technical, or abstract visual content while leveraging the base model's advanced multimodal fusion with Interleaved-MRoPE, 32-language OCR, 262K context length, video understanding, and robust spatial reasoning. It produces descriptive, reasoning-focused outputs with variational control—from concise summaries to intricate multi-level analyses—supporting diverse resolutions, aspect ratios, and layouts primarily in English with multilingual prompt adaptability, making it ideal for research, red-teaming, creative generation, and agentic tasks without guardrails. This abliterated version delivers factual responses on high-end GPUs (16-24GB VRAM BF16/FP8), compatible with Transformers/Qwen3VLForConditionalGeneration and vLLM for efficient local inference in unrestricted visual applications.

Qwen3-VL-8B-Instruct-abliterated-v1 [GGUF]

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):