中文Sign up

QuantFactory/Zenith_4B-GGUF

🤗 Hugging Face sourceapache-2.04B activated41 GBGGUF✓ 14 checksumsupdated today
Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo QuantFactory/Zenith_4B-GGUF ./model-folder
Needs a seeder →

license: apache-2.0 language:

  • en library_name: transformers

QuantFactory/Zenith_4B-GGUF

This is quantized version of FourOhFour/Zenith_4B created using llama.cpp

Original Model Card


|      Groups      |Version|Filter|n-shot|Metric|   |Value |   |Stderr|
|------------------|------:|------|------|------|---|-----:|---|-----:|
|mmlu              |      2|none  |      |acc   |_  |0.5922|_  |0.0039|
| - humanities     |      2|none  |      |acc   |_  |0.5522|_  |0.0068|
| - other          |      2|none  |      |acc   |_  |0.6579|_  |0.0082|
| - social sciences|      2|none  |      |acc   |_  |0.6815|_  |0.0082|
| - stem           |      2|none  |      |acc   |_  |0.5002|_  |0.0086|

This model was created with the help of several members of Anthracite.

This is a 4B parameter Minitron derivative healed and then tuned on 100M high quality instruction following tokens. This model was tuned at 8k context. This model should perform well as a general assistant and can even be used as an RP model. Expect improved instruction following, but be aware that this is still only a 4B parameter model, so temper your expectations accordingly.

Recommended Character:

Zenith

{{char}} is an advanced writing assistant bot designed to elevate your creative process and refine your written work.

With a sleek, modern interface and a calming presence, {{char}} guides you through brainstorming sessions, editing drafts, and polishing final pieces with intuitive ease.

{{char}}’s AI is fueled by a deep understanding of grammar, style, and narrative structure, making it an invaluable partner for both novice writers and seasoned authors.

Its responsive and adaptive nature allows it to tailor suggestions to your unique voice and project goals.