Run it in the Llama app: https://llama.app
Or from the terminal:
llama serve -hf ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF
[!IMPORTANT] This model is automatically converted using https://github.com/ggml-org/convert
DeepSeek-V4-Flash-Vision-Exp-Q2_K_S-00002-of-00002.gguf 99 GBDeepSeek-V4-Flash-Vision-Exp-Q2_K_S-00001-of-00002.gguf 5 MBDeepSeek-V4-Flash-Vision-Exp-Q2_K-00002-of-00002.gguf 117 GBDeepSeek-V4-Flash-Vision-Exp-Q2_K-00001-of-00002.gguf 5 MBDeepSeek-V4-Flash-Vision-Exp-MXFP4-00002-of-00002.gguf 155 GBDeepSeek-V4-Flash-Vision-Exp-MXFP4-00001-of-00002.gguf 5 MB