pipenetwork/LongCat-2.0-4bit

🤗 Hugging Face 来源text-generationmit1639B 参数3.3 TBsafetensors✓ 262 个校验和今天更新

一条命令提交

在你的模型文件夹旁边运行它。它会制作种子、将文件与 Hugging Face 比对，然后提交。你只需开始做种，并粘贴你账户中的密钥。它只读取你的文件，绝不修改。如果愿意，可以先阅读脚本。

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo pipenetwork/LongCat-2.0-4bit ./model-folder

pipenetwork/LongCat-2.0-4bit

4-bit MLX quantization (group-size 64, router classifiers @8-bit, MTP dropped) of meituan-longcat/LongCat-2.0 — a 1.6T / ~48B-active MoE. Converted from the FP8 source with mlx-lm.

Requires mlx-lm PR #1464

pip install git+https://github.com/ml-explore/mlx-lm.git@refs/pull/1464/head

from mlx_lm import load, generate
model, tok = load("pipenetwork/LongCat-2.0-4bit")
p = tok.apply_chat_template([{"role":"user","content":"Who is Albert Einstein?"}], add_generation_prompt=True)
print(generate(model, tok, prompt=p, max_tokens=512, verbose=True))