Intel/Qwen2-0.5B-Instruct-int4-sym-AutoRound

🤗 Hugging Face 来源apache-2.0184M 参数458 MBsafetensors✓ 2 个校验和今天更新

一条命令提交

在你的模型文件夹旁边运行它。它会制作种子、将文件与 Hugging Face 比对，然后提交。你只需开始做种，并粘贴你账户中的密钥。它只读取你的文件，绝不修改。如果愿意，可以先阅读脚本。

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Intel/Qwen2-0.5B-Instruct-int4-sym-AutoRound ./model-folder

This model is an int4 model with group_size 128 and symmetric quantization of Qwen/Qwen2-0.5B-Instruct generated by intel/auto-round algorithm.

⚠️ Important: This model is used for internal testing with VLLM. Please do not delete or modify without approval.