nanoBeard Frigate 360M (pirate chat)
GGUF quantizations of a nanoBeard Frigate pirate chat model (358.3M params), for on-device inference with llama.cpp and the NanoBeard mobile app. SFT val loss ≈ 3.036.
Frigate's architecture (RoPE + SwiGLU + RMSNorm + per-head QK-norm, no biases,
tied embeddings) is Qwen3-equivalent, so these load with the upstream qwen3
GGUF arch — no custom runtime needed.
Files
| file | quant | size | use |
|---|---|---|---|
frigate-360M.Q4_K_M.gguf |
Q4_K_M | 223 MB | default — phones |
frigate-360M.Q8_0.gguf |
Q8_0 | 364 MB | quality fallback |
Q4_K_M is the default for phones (smallest + fastest). Q8_0 is a near-lossless
fallback when you have the storage and want max quality.
Chat format
Plain-text turns (no chat template). Build the prompt as:
User: <your message>
Pirate:
Turns are separated by a single newline; stop generation at the <|endoftext|>
token. Example with llama.cpp:
llama-completion -m frigate-360M.Q4_K_M.gguf \
-p $'User: Tell me about the sea.\nPirate:' -n 80 --temp 0.8 --top-k 40
Tokenizer
Custom 16,384-token byte-level BPE (GPT-2-style pre-tokenizer), embedded in the GGUF. No external tokenizer file required.