This model kernelpool/GLM-5.2-6bit was converted to MLX format from zai-org/GLM-5.2 using mlx-lm version 0.31.3.
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("kernelpool/GLM-5.2-6bit")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True, return_dict=False,
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
model-00021-of-00121.safetensors 5.4 GBmodel-00053-of-00121.safetensors 5.4 GBmodel-00037-of-00121.safetensors 5.4 GBmodel-00085-of-00121.safetensors 5.4 GBmodel-00117-of-00121.safetensors 5.4 GBmodel-00029-of-00121.safetensors 5.4 GBmodel-00045-of-00121.safetensors 5.4 GBmodel-00109-of-00121.safetensors 5.4 GBmodel-00077-of-00121.safetensors 5.4 GBmodel-00101-of-00121.safetensors 5.4 GBmodel-00069-of-00121.safetensors 5.4 GBmodel-00005-of-00121.safetensors 5.4 GBmodel-00013-of-00121.safetensors 5.4 GBmodel-00093-of-00121.safetensors 5.4 GBmodel-00061-of-00121.safetensors 5.4 GBmodel-00024-of-00121.safetensors 5.3 GBmodel-00040-of-00121.safetensors 5.3 GBmodel-00056-of-00121.safetensors 5.3 GBmodel-00072-of-00121.safetensors 5.3 GBmodel-00080-of-00121.safetensors 5.3 GBmodel-00016-of-00121.safetensors 5.3 GBmodel-00088-of-00121.safetensors 5.3 GBmodel-00096-of-00121.safetensors 5.3 GBmodel-00104-of-00121.safetensors 5.3 GBmodel-00112-of-00121.safetensors 5.3 GBmodel-00032-of-00121.safetensors 5.3 GBmodel-00048-of-00121.safetensors 5.3 GBmodel-00120-of-00121.safetensors 5.3 GBmodel-00064-of-00121.safetensors 5.3 GBmodel-00008-of-00121.safetensors 5.3 GBmodel-00002-of-00121.safetensors 5.3 GBmodel-00003-of-00121.safetensors 5.3 GBmodel-00076-of-00121.safetensors 5.3 GBmodel-00031-of-00121.safetensors 5.3 GBmodel-00044-of-00121.safetensors 5.3 GBmodel-00063-of-00121.safetensors 5.3 GBmodel-00095-of-00121.safetensors 5.3 GBmodel-00057-of-00121.safetensors 5.3 GBmodel-00012-of-00121.safetensors 5.3 GBmodel-00089-of-00121.safetensors 5.3 GBmodel-00108-of-00121.safetensors 5.3 GBmodel-00025-of-00121.safetensors 5.3 GBmodel-00100-of-00121.safetensors 5.3 GBmodel-00033-of-00121.safetensors 5.3 GBmodel-00041-of-00121.safetensors 5.3 GBmodel-00028-of-00121.safetensors 5.3 GBmodel-00039-of-00121.safetensors 5.3 GBmodel-00047-of-00121.safetensors 5.3 GBmodel-00055-of-00121.safetensors 5.3 GBmodel-00068-of-00121.safetensors 5.3 GBmodel-00071-of-00121.safetensors 5.3 GBmodel-00119-of-00121.safetensors 5.3 GBmodel-00049-of-00121.safetensors 5.3 GBmodel-00081-of-00121.safetensors 5.3 GBmodel-00105-of-00121.safetensors 5.3 GBmodel-00113-of-00121.safetensors 5.3 GBmodel-00097-of-00121.safetensors 5.3 GBmodel-00087-of-00121.safetensors 5.3 GBmodel-00020-of-00121.safetensors 5.3 GBmodel-00065-of-00121.safetensors 5.3 GBmodel-00079-of-00121.safetensors 5.3 GBmodel-00004-of-00121.safetensors 5.3 GBmodel-00009-of-00121.safetensors 5.3 GBmodel-00007-of-00121.safetensors 5.3 GBmodel-00023-of-00121.safetensors 5.3 GBmodel-00060-of-00121.safetensors 5.3 GBmodel-00017-of-00121.safetensors 5.3 GBmodel-00073-of-00121.safetensors 5.3 GBmodel-00084-of-00121.safetensors 5.3 GBmodel-00092-of-00121.safetensors 5.3 GBmodel-00111-of-00121.safetensors 5.3 GBmodel-00116-of-00121.safetensors 5.3 GBmodel-00015-of-00121.safetensors 5.3 GBmodel-00052-of-00121.safetensors 5.3 GBmodel-00036-of-00121.safetensors 5.3 GBmodel-00103-of-00121.safetensors 5.3 GBmodel-00070-of-00121.safetensors 5.3 GBmodel-00102-of-00121.safetensors 5.3 GBmodel-00038-of-00121.safetensors 5.3 GBmodel-00006-of-00121.safetensors 5.3 GBmodel-00022-of-00121.safetensors 5.3 GBmodel-00078-of-00121.safetensors 5.3 GBmodel-00014-of-00121.safetensors 5.3 GBmodel-00030-of-00121.safetensors 5.3 GBmodel-00054-of-00121.safetensors 5.3 GBmodel-00094-of-00121.safetensors 5.3 GBmodel-00110-of-00121.safetensors 5.3 GBmodel-00046-of-00121.safetensors 5.3 GBmodel-00062-of-00121.safetensors 5.3 GBmodel-00118-of-00121.safetensors 5.3 GBmodel-00086-of-00121.safetensors 5.3 GBmodel-00043-of-00121.safetensors 5.2 GBmodel-00051-of-00121.safetensors 5.2 GBmodel-00067-of-00121.safetensors 5.2 GBmodel-00075-of-00121.safetensors 5.2 GBmodel-00083-of-00121.safetensors 5.2 GBmodel-00091-of-00121.safetensors 5.2 GBmodel-00115-of-00121.safetensors 5.2 GBmodel-00027-of-00121.safetensors 5.2 GBmodel-00059-of-00121.safetensors 5.2 GBmodel-00107-of-00121.safetensors 5.2 GBmodel-00019-of-00121.safetensors 5.2 GBmodel-00035-of-00121.safetensors 5.2 GBmodel-00099-of-00121.safetensors 5.2 GBmodel-00011-of-00121.safetensors 5.2 GBmodel-00001-of-00121.safetensors 4.5 GBmodel-00082-of-00121.safetensors 3.0 GBmodel-00050-of-00121.safetensors 3.0 GBmodel-00114-of-00121.safetensors 3.0 GBmodel-00018-of-00121.safetensors 3.0 GBmodel-00074-of-00121.safetensors 3.0 GBmodel-00034-of-00121.safetensors 3.0 GBmodel-00058-of-00121.safetensors 3.0 GBmodel-00066-of-00121.safetensors 3.0 GBmodel-00026-of-00121.safetensors 3.0 GBmodel-00098-of-00121.safetensors 3.0 GBmodel-00106-of-00121.safetensors 3.0 GBmodel-00090-of-00121.safetensors 3.0 GBmodel-00042-of-00121.safetensors 3.0 GBmodel-00010-of-00121.safetensors 3.0 GBmodel-00121-of-00121.safetensors 908 MB有文件?提交种子。
提交种子zai-org/GLM-5.2