Models
29 models Β· 91k downloads
inference-optimization/Llama-3.2-0.5B-Instructinference-optimization/Qwen3-1.6B-A0.9Binference-optimization/Qwen3-8B-from-Qwen3-8B_regen-speculators.eagle3-qwen3arch-ckpt1inference-optimization/Qwen3-8B-speculators.peagle-qwen3arch-ckpt4inference-optimization/Qwen3-Coder-Next.w4a16inference-optimization/GLM-5.2-0.8B-A0.8Binference-optimization/Qwen3.8-1.0B-A0.6Binference-optimization/NemotronH-0.3B-A0.3Binference-optimization/Kimi-K3-0.40B-MXFP4inference-optimization/GLM-5.3-Flash-0.1B-A0.1Binference-optimization/Kimi-K3-0.40Binference-optimization/Qwen3.8-Flash-Next-0.2B-A0.2Binference-optimization/Qwen3.6-8B-A1.6Binference-optimization/GLM-5.3-0.6B-A0.4Binference-optimization/Inkling-0.6B-A0.6Binference-optimization/DeepSeek-V4-Pro-0.5B-A0.37Binference-optimization/Phi-3.5-MoE-0.8B-A0.2Binference-optimization/Llama-4-Scout-1.7B-0.4B-Instructinference-optimization/Qwen3-VL-1.0B-A0.4B-Instructinference-optimization/Nemotron-3.5-Lightning-1.4B-A0.1B-MTPinference-optimization/Qwen3-30B-A3B-Thinking-2507-REAP-25-uniforminference-optimization/Qwen3-30B-A3B-Thinking-2507-REAP-25-nonuniforminference-optimization/Qwen3.8-27B-DSpark-Gauss-NVFP4-W4A4inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-NVFP4-W4A4inference-optimization/Qwen3-8B-DFlash-Gauss-NVFP4-W4A4inference-optimization/Qwen3-Coder-Next.w8a8inference-optimization/Qwen3-8B-DFlash-PerfectBlend-NVFP4-W4A4inference-optimization/DeepSeek-R1-Distill-Llama-8B-NVFP4inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w4a16