Qwen3.5-4B MLX 8-bit

This repository contains an MLX-LM conversion of Qwen/Qwen3.5-4B.

Conversion Details

• Original model: Qwen/Qwen3.5-4B
• Model family: Qwen3.5
• Source model type: qwen3_5
• Model size: 4,659,865,088 parameters
• Quantization: MLX-LM affine quantization
• Bits: 8-bit
• Group size: 64
• Local MLX folder size at upload time: 4.18 GiB
• Local safetensors weight size at upload time: 4.16 GiB

Usage

mlx_lm.generate --model DreamFoundries/Qwen3.5-4B-8bit --prompt "Hello" --max-tokens 64

Benchmarks

No comparative benchmarks have been run yet. The repository does not currently provide quality, speed, memory, or benchmark comparisons against the original weights or other quantizations.

License

This is a converted/quantized derivative of the original model. Please refer to the original model repository for the upstream license and usage terms: https://huggingface.co/Qwen/Qwen3.5-4B

---