GPT-Elegance
GPT-Elegance is a lightweight, 47-million-parameter general-purpose LLM trained using the Simple English Wikipedia.
Technical Information
| Layers | 6 |
| Heads | 4 |
| Embeddings | 256 |
| Context Window | 65536 tokens |
| Tokenizer | cl100k_base |
GPT-Elegance is a lightweight, 47-million-parameter general-purpose LLM trained using the Simple English Wikipedia.
| Layers | 6 |
| Heads | 4 |
| Embeddings | 256 |
| Context Window | 65536 tokens |
| Tokenizer | cl100k_base |