Sign up

gguf-org/muse-glimmer-30b-gguf

🤗 Hugging Face sourceapache-2.012 GBGGUF✓ Checksums witnessedupdated today
No torrent yet →

muse-glimmer-30b-gguf

  • execute tools and/or agentic workflow
  • fit in 12GB vram/ram or less

run it with ggk

ggk server engine -- -m muse-glimmer-30b-nvfp4.gguf --mmproj mmproj-q4_0.gguf --jinja --spec-type draft-dflash -md dflash-q4_0.gguf --spec-draft-n-max 3 -ts 1,0

or run it with llama.cpp

./llama-server -m muse-glimmer-30b-nvfp4.gguf --mmproj mmproj-q4_0.gguf --jinja --spec-type draft-dflash -md dflash-q4_0.gguf --spec-draft-n-max 3 --host 127.0.0.1 --port 8888

or opt lmstudio, etc.