中文Sign up

Abiray/Qwen3.8-27B-Q4_K_M-GGUF

🤗 Hugging Face sourceimage-text-to-textapache-2.027B activated18 GBGGUF✓ 2 checksumsupdated today
Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Abiray/Qwen3.8-27B-Q4_K_M-GGUF ./model-folder
Needs a seeder →

Qwen3.8-27B GGUF (Vision-Language)

This repository contains the GGUF format quantization of the Qwen3.8-27B model, a native vision-language model.

The model has been quantized using llama.cpp (release b10430) to the Q4_K_M format.

File Details

  • Model Name: Qwen3.8-27B
  • Quantization: Q4_K_M
  • Main Model: Qwen3.8-27B-Q4_K_M.gguf (16.8 GB)
  • Vision Adapter: mmproj-F16.gguf (Required for vision/multimodal tasks)
  • Quantization Tool: llama.cpp (b10430)

About Qwen3.8-27B

Qwen3.8-27B is the most capable generation in the Qwen open-model family, built on the architectural foundation of Qwen3.5. It is a native vision-language model that understands images and videos, delivering substantial gains across coding, professional work, research, and long-horizon agentic tasks.

For more information, please visit the original model card.

Usage

llama.cpp (Text Only)

To run this model as a text-only model using llama.cpp from the command line:

./llama-cli -m Qwen3.8-27B-Q4_K_M.gguf -p "Write a Python function to merge two sorted linked lists." -n 5124

llama.cpp (Vision-Language)

To utilize the vision capabilities, you must provide the mmproj file using the --mmproj flag:

./llama-cli -m Qwen3.8-27B-Q4_K_M.gguf \
  --mmproj mmproj-F16.gguf \
  --image path/to/your/image.jpg \
  -p "Describe the contents of this image."

LM Studio / Ollama / GPT4All

This GGUF file is compatible with popular local LLM inference tools. When configuring the model in your preferred client, ensure you attach the mmproj-F16.gguf file in the "Vision Adapter" or "Multimedia Projection" setting to enable image processing.

Acknowledgements

The original model was developed and released by the Qwen Team.