中文Sign up

mys/kev-0.5b-GGUF

🤗 Hugging Face sourceapache-2.0500M activated2.1 GBGGUF✓ 3 checksumsupdated today
Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo mys/kev-0.5b-GGUF ./model-folder
Needs a seeder →

Kev 0.5B GGUF (ggmlc)

English System 1 decision model compiled from jaredpalmer/kev-0.5b (Qwen2.5-0.5B backbone, LoRA merged in fp32 before export, context 2048).

These files are not llama.cpp / llama-cli GGUFs. They are produced by ggmlc. Loading them in llama.cpp will fail.

Typed questions (choice / score / noul) are scored in one forward. There is no autoregressive token generation. Tokenizer, sequence program, and postprocess live in the GGUF (ggmlc.decision).

Source and CLI: examples/laya

Larger hybrid: kev-0.8b-GGUF

Files

File Quant Size Notes
kev_0.5b_f16.gguf F16 ~965 MB Best numerical match.
kev_0.5b_q8_0.gguf Q8_0 ~523 MB Uniform Q8_0. 1D norms stay F32.
kev_0.5b_ud_q4_k_m.gguf UD_Q4_K_M ~545 MB Embedding stays F16, sensitive projections Q8_0, other weights Q4_0. Not smaller than Q8_0 on this vocabulary. 
huggingface-cli download mys/kev-0.5b-GGUF kev_0.5b_f16.gguf --local-dir .

Run with laya

laya info kev_0.5b_f16.gguf
laya decide kev_0.5b_f16.gguf --preset email --device auto --cuda-graph
laya serve kev_0.5b_f16.gguf --port 8080 --device auto --cuda-graph
laya bench kev_0.5b_f16.gguf --preset email --device auto --cuda-graph

serve is Decision Studio plus POST /v1/systemone (TypeSafe). The advertised model id is kev-0.5b.

License

Apache 2.0, same as jaredpalmer/kev-0.5b. Compiler: ggmlc (MIT).