GPT-MUD
GPT-MUD is a lightweight, 47-million-parameter LLM designed to play NPC characters in games. Trained using the ClubFloyd corpus, an MUD-like dataset.
Technical Information
| Layers | 6 |
| Heads | 4 |
| Embeddings | 256 |
| Context Window | 65536 tokens |
| Tokenizer | cl100k_base |