English注册

Cannae-AI/TANIT-V0.6-4B-IT-gguf

🤗 Hugging Face 来源image-text-to-textapache-2.0激活 4B5.0 GBGGUF✓ 2 个校验和今天更新
一条命令提交

在你的模型文件夹旁边运行它。它会制作种子、将文件与 Hugging Face 比对，然后提交。你只需开始做种，并粘贴你账户中的密钥。它只读取你的文件，绝不修改。如果愿意，可以先阅读脚本。

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Cannae-AI/TANIT-V0.6-4B-IT-gguf ./model-folder
需要做种者 →

TANIT-V0.6-4B-IT-gguf

  • Developed by: CannaeAI
  • License: apache-2.0
  • quantized by : Cannae-AI
  • Base model : CannaeAI/TANIT-V0.6-4B-IT

Available Model files:

  • TANIT-V0.6-4b-it.Q8_0.gguf
  • TANIT-V0.6-4b-it.BF16-mmproj.gguf

⚠️ Ollama Note for Vision Models

Important: Ollama currently does not support separate mmproj files for vision models.

To create an Ollama model from this vision model:

  1. Place the Modelfile in the same directory as the finetuned bf16 merged model
  2. Run: ollama create model_name -f ./Modelfile (Replace model_name with your desired name)

This will create a unified bf16 model that Ollama can use.

Note

The model's BOS token behavior was adjusted for GGUF compatibility.