DeepSeek-V4-Flash-0731

Run it in the Llama app: https://llama.app

Or from the terminal:

llama serve -hf ggml-org/DeepSeek-V4-Flash-0731-GGUF

Source models

• https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731

Notes

• Currently, the Q2 models do not use an imatrix calibration due to lack of one.

TODOs

• add info

[!IMPORTANT] This model is automatically converted using https://github.com/ggml-org/convert