中文Sign up

Cannae-AI/TANIT-V0.6-12B-IT-gguf

🤗 Hugging Face sourceapache-2.012B activated13 GBGGUF✓ 2 checksumsupdated today
Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Cannae-AI/TANIT-V0.6-12B-IT-gguf ./model-folder
Needs a seeder →

TANIT-V0.6-12B-IT-gguf

  • Developed by: CannaeAI
  • License: apache-2.0
  • quantized by : Cannae-AI
  • Base model : CannaeAI/TANIT-V0.6-12B-IT

Available Model files:

  • TANIT-V0.6-12b-it.Q8_0.gguf
  • TANIT-V0.6-12b-it.BF16-mmproj.gguf

⚠️ Ollama Note for Vision Models

Important: Ollama currently does not support separate mmproj files for vision models.

To create an Ollama model from this vision model:

  1. Place the Modelfile in the same directory as the finetuned bf16 merged model
  2. Run: ollama create model_name -f ./Modelfile (Replace model_name with your desired name)

This will create a unified bf16 model that Ollama can use.

Note

The model's BOS token behavior was adjusted for GGUF compatibility.