jamiefutch/Qwen3.6-40B-Heretic-MTP-GGUF-Q4_K_M

🤗 Hugging Face 来源text-generationapache-2.0激活 40B24 GBGGUF✓ 1 个校验和今天更新
已有模型文件?提交模型种子

如果你有完整的模型文件并有权分享,请把示例文件夹路径替换为你的文件路径,再运行这条命令。它会校验文件、制作种子,并将磁力链接和校验和提交给 Pirate Face。请让种子客户端持续做种,方便其他人从节点下载。Pirate Face 不接收模型文件。你可以从账户页面获取社区密钥。也可以先阅读脚本。

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo jamiefutch/Qwen3.6-40B-Heretic-MTP-GGUF-Q4_K_M ./model-folder
需要做种者 →

Qwen3.6 40B Heretic MTP GGUF Q4_K_M

This repository provides a Q4_K_M GGUF quantization derived from:

markmonger/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-iMatrix-MTP-GGUF

The source repository provides the MTP GGUF model as q8_0-v1.gguf and is licensed under Apache-2.0.

Files

File Quantization SHA256
q4_k_m-v1.gguf Q4_K_M c9791ad1fda0c2cb0290c268c035d888121e3d5e84a9e6f0a6b34618cc081d90

Usage

With llama.cpp:

llama-cli -hf m233zhan/Qwen3.6-40B-Heretic-MTP-GGUF-Q4_K_M:q4_k_m-v1.gguf

Or start an OpenAI-compatible local server:

llama-server -hf m233zhan/Qwen3.6-40B-Heretic-MTP-GGUF-Q4_K_M:q4_k_m-v1.gguf

Provenance

Model lineage shown by the upstream repository:

  • Base model: Qwen/Qwen3.6-27B
  • Finetuned model: DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking
  • MTP GGUF source: markmonger/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-iMatrix-MTP-GGUF

This repository only adds the Q4_K_M GGUF quantization.