FrogNano-4B-2609 EXL3 4.00 bpw
Source: https://huggingface.co/microsoft/FrogNano-4B-2609
Source revision: b90468c11a913c1916b4542b4b7a530ec42024a4
ExLlamaV3 revision: 1.5.2+cu128.torch2.10.0
Target bitrate: 4.00 bpw
Architecture: Qwen3_5ForConditionalGeneration
This conversion was produced with ExLlamaV3's official convert.py and passed a local load/generation smoke test before publication.
Local validation
- Generated tokens: 64
- Decode speed: 193.354 tok/s
- GPU: NVIDIA GeForce RTX 4090
- Torch: 2.10.0+cu128
The speed figure is a local smoke benchmark, not a cross-system performance claim.