加载中…
加载中…
🤗 Hugging Face | 🤖 ModelScope | 🐙 OpenRouter
Ling-3.0-tiny is a lightweight hybrid reasoning MoE model with 7.9B total parameters and only 1.3B activated parameters per token. It is designed to deliver strong reasoning and agentic capabilities at low inference cost, making advanced model capabilities more accessible for local and resource-constrained deployment.
Find more details in the original model card: https://huggingface.co/inclusionAI/Ling-3.0-tiny
llama-bench -m Ling-3.0-tiny-Q8_0.gguf -p 512 -n 128 -ngl 99 -fa 1在 LocalMaxxing 上查看测试
来自 LocalMaxxing 的 1 次社区测试(1 种配置)的中位数。
自己运行:配置指南