Muse-Glimmer-30B
Run it in the Llama app: https://llama.app
Or from the terminal:
llama serve -hf ggml-org/Muse-Glimmer-30B-GGUF
Source models
- https://huggingface.co/meta-models/Muse-Glimmer-30B
- https://huggingface.co/meta-models/Muse-Glimmer-30B-assistant
Notes
- Includes a Q8_0 mmproj for the vision encoder.
- Includes a DFlash drafter sidecar (BF16, Q8_0 and Q4_0) for speculative decoding.
TODOs
- add info
[!IMPORTANT] This model is automatically converted using https://github.com/ggml-org/convert