Agents-A1-4B EXL3 4.00 bpw
Source: https://huggingface.co/InternScience/Agents-A1-4B
Source revision: 945c40a4aa6f534d434a353207b8d42ecf7a5293
ExLlamaV3 revision: 1.5.2+cu128.torch2.10.0
Target bitrate: 4.00 bpw
Architecture: Qwen3_5ForConditionalGeneration
This conversion was produced with ExLlamaV3's official convert.py and passed a local load/generation smoke test before publication.
Local validation
- Generated tokens: 64
- Decode speed: 23.21 tok/s
- GPU: NVIDIA GeForce RTX 4090
- Torch: 2.10.0+cu128
The speed figure is a local smoke benchmark, not a cross-system performance claim.