Run it in the Llama app: https://llama.app
Or from the terminal:
llama serve -hf ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF
[!IMPORTANT] This model is automatically converted using https://github.com/ggml-org/convert
DeepSeek-V4-Flash-Vision-Exp-Q2_K_S-00002-of-00002.gguf 99 GBDeepSeek-V4-Flash-Vision-Exp-Q2_K_S-00001-of-00002.gguf 5 MBDeepSeek-V4-Flash-Vision-Exp-Q2_K-00002-of-00002.gguf 117 GBDeepSeek-V4-Flash-Vision-Exp-Q2_K-00001-of-00002.gguf 5 MBDeepSeek-V4-Flash-Vision-Exp-MXFP4-00002-of-00002.gguf 155 GBDeepSeek-V4-Flash-Vision-Exp-MXFP4-00001-of-00002.gguf 5 MBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF ./model-folderdeepseek-ai/DeepSeek-V4-Flash-Vision-Exp