nanoBeard Galleon 34M (pirate chat, GPT-2)
GGUF quantizations of nanoBeard Galleon — a 34M GPT-2-style pirate chat model, loaded via llama.cpp's gpt2 arch (34M params), for on-device inference with
llama.cpp and the NanoBeard mobile app.
Val loss ≈ 3.011.
Files
| file | quant | size | use |
|---|---|---|---|
galleon-34M.Q4_K_M.gguf |
Q4_K_M | 23.6 MB | default — phones |
galleon-34M.Q8_0.gguf |
Q8_0 | 35.8 MB | quality fallback |
Q4_K_M is the default for phones (smallest + fastest). Q8_0 is a near-lossless
fallback when you have the storage and want max quality.
Chat format
Plain-text turns (no chat template). Build the prompt as:
User: <your message>
Pirate:
Turns are separated by a single newline; stop generation at the <|endoftext|>
token. Example with llama.cpp:
llama-completion -m galleon-34M.Q4_K_M.gguf \
-p $'User: Tell me about the sea.\nPirate:' -n 80 --temp 0.8 --top-k 40
Tokenizer
Custom 16,384-token byte-level BPE (GPT-2-style pre-tokenizer), embedded in the GGUF. No external tokenizer file required.