awq version of agentica-org/DeepCoder-14B-Preview
quant_config = {
"zero_point": True,
"q_group_size": 128,
"w_bit": 4,
"version": "GEMM"
}
awq version of agentica-org/DeepCoder-14B-Preview
quant_config = {
"zero_point": True,
"q_group_size": 128,
"w_bit": 4,
"version": "GEMM"
}
model-00001-of-00003.safetensors 5.0 GBmodel-00002-of-00003.safetensors 5.0 GBmodel-00003-of-00003.safetensors 3.1 GBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo patrickbdevaney/deepcoder-14b-awq ./model-folder