vllm-d3

Run it in the Llama app: https://llama.app

Or from the terminal:

llama serve -hf ggml-org/vllm-d3-GGUF

This is a decision model, to be used via /v1/systemone API. See https://github.com/ggml-org/llama.cpp/pull/30383

Source models

• https://huggingface.co/vllm-sr/d3

[!IMPORTANT] This model is automatically converted using https://github.com/ggml-org/convert