English注册

Reza2kn/MiniCPM5-1B-MLX-DWQ-4bit

🤗 Hugging Face 来源text-generationapache-2.01.1B 参数2.2 GBsafetensors✓ 1 个校验和今天更新
一条命令提交

在你的模型文件夹旁边运行它。它会制作种子、将文件与 Hugging Face 比对，然后提交。你只需开始做种，并粘贴你账户中的密钥。它只读取你的文件，绝不修改。如果愿意，可以先阅读脚本。

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Reza2kn/MiniCPM5-1B-MLX-DWQ-4bit ./model-folder
需要做种者 →

MiniCPM5-1B MLX DWQ 4-bit

MLX 4-bit quantization of openbmb/MiniCPM5-1B.

Quantization

  • Runtime: MLX / mlx-lm
  • Bits: 4
  • Group size: 64
  • Mode: affine
  • Observed packed size: about 580 MB
  • Conversion log: mlx_lm.convert reported 4.501 bits per weight

Smoke Test

Local Apple M2 smoke test:

  • Prompt tokens: 17
  • Prompt speed: 28.621 tok/s
  • Generation speed: 133.897 tok/s
  • Peak memory: 0.674 GB

Validation Status

Runtime loading and generation work, but this artifact is not yet release-approved on the strict multilingual/code/tool-use validation matrix. Known failures include Persian response quality, Arabic arithmetic response quality, and reasoning leakage on tool-planning prompts.

Usage

pip install -U mlx-lm
mlx_lm.generate --model Reza2kn/MiniCPM5-1B-MLX-DWQ-4bit --prompt "Hello" --max-tokens 64

Licensing and attribution

This model distribution is licensed under the Apache License, Version 2.0. See LICENSE. Existing third-party copyright, license, and attribution notices remain applicable.