This is the official MatGPTQ checkpoint of Qwen/Qwen3-8B, produced as described in the "MatGPTQ: Efficient and Accurate Inference over Nested Quantized Models" paper.
This model can be run via vLLM. Checkout our integration at IST-DASLab/MatGPTQ
This is the official MatGPTQ checkpoint of Qwen/Qwen3-8B, produced as described in the "MatGPTQ: Efficient and Accurate Inference over Nested Quantized Models" paper.
This model can be run via vLLM. Checkout our integration at IST-DASLab/MatGPTQ