中文Sign up

mondk/Msh-Tiny-47M-GGUF

🤗 Hugging Face sourcetext-generationapache-2.0336 MBGGUF✓ 3 checksumsupdated today
Have the files? Submit a model torrent

If you have the complete model files and permission to share them, replace the example folder path and run this command. It checks your files, creates a torrent, and submits the magnet and checksums to Pirate Face. Keep your torrent client seeding so others can download from peers. Pirate Face does not receive the model files. Get your community key from your account. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo mondk/Msh-Tiny-47M-GGUF ./model-folder
Needs a seeder →

msh-tiny (GGUF)

A tiny (~47M parameter) GPT-2-style chat model, trained completely from scratch — no pretrained base model, custom BPE tokenizer trained from zero, custom PyTorch transformer architecture. This repo contains GGUF builds for use with llama.cpp, Ollama, and LM Studio.

The .safetensors source model is at mondk/Msh-Tiny-47M.

Limitations

This model was trained from random initialization on a modest amount of data with limited compute — it is a small educational project, not a production-quality assistant. Expect it to follow the chat format reliably but produce limited/inconsistent knowledge and occasional incoherent answers.

Prompt format

<|user|>
{your message}
<|assistant|>

The model was trained to stop generating at <|end|>.

Usage

Ollama

FROM ./model-f16.gguf

ollama create msh-tiny -f Modelfile
ollama run msh-tiny

LM Studio: drop the .gguf file into your models folder and load it directly.

llama.cpp

./llama-cli -m model-f16.gguf -p "<|user|>\nhi\n<|assistant|>\n"

Training data

Combining 15 well-known open instruction/chat datasets plus a small hand-written set of everyday chit-chat (greetings, thanks, small talk):

  • mondk/Greetings-hi-for-train-Msh-v2
  • tatsu-lab/alpaca
  • databricks/databricks-dolly-15k
  • teknium/OpenHermes-2.5
  • m-a-p/Code-Feedback
  • OpenAssistant/oasst1
  • FreedomIntelligence/medical-o1-reasoning-SFT
  • glaiveai/glaive-function-calling-v2
  • openai/openai_humaneval
  • HuggingFaceH4/no_robots
  • open-thoughts/OpenThoughts-114k
  • HuggingFaceH4/ultrachat_200k
  • google-research-datasets/poem_sentiment
  • CohereLabs/aya_dataset
  • sentence-transformers/natural-questions