IQ2_S quant done off an imatrix from a Q4_K quant because I can't run any higher on my potato PC. Use at your own risk.
在你的模型文件夹旁边运行它。它会制作种子、将文件与 Hugging Face 比对,然后提交。你只需开始做种,并粘贴你账户中的密钥。它只读取你的文件,绝不修改。如果愿意,可以先阅读脚本。
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo ilintar/THUDM-GLM-4-32B-0414-IQ2_S.GGUF ./model-folderIQ2_S quant done off an imatrix from a Q4_K quant because I can't run any higher on my potato PC. Use at your own risk.