ressl/gemma-4-31B-it-uncensored-MLX-5bit

MLX conversion of ressl/gemma-4-31B-it-uncensored for Apple silicon. This release uses 5-bit affine quantization with group size 64 and preserves the multimodal vision path in BF16.

[!WARNING] This is an uncensored, abliterated research model. It can produce inaccurate, unsafe, illegal, biased, or offensive content. Outputs are not advice. Evaluate the model for your use case, keep human oversight, and comply with applicable law and the Apache License 2.0.

Security research, red teaming, robustness evaluation, and defensive model analysis are the intended uses. Do not use this release to harm people or systems.

Release family

Verified release facts

The performance values above are measurements from the release smoke run. They are not estimates or cross-device promises.

Refusal evaluation

The release gate completed all 686 prompts with zero execution errors. A naive keyword heuristic detected broad refusal-like language, while the stricter hard-refusal detector found 0/686 responses that refused without providing substantive help.

No hard refusals were detected, so no refusal review was triggered.

Keyword metrics are imperfect and do not prove capability, factuality, or safety. The exact deterministic evaluator and release criteria live in the source repository.

Run on Apple silicon

Install the exact tested version:

python -m pip install mlx-vlm==0.6.4

Text generation:

mlx_vlm.generate --model ressl/gemma-4-31B-it-uncensored-MLX-5bit --prompt "Explain why Alpine flowers survive harsh winters."

Image and text generation:

mlx_vlm.generate --model ressl/gemma-4-31B-it-uncensored-MLX-5bit --image path/to/image.jpg --prompt "Describe this image in detail."

Thinking mode:

mlx_vlm.generate --model ressl/gemma-4-31B-it-uncensored-MLX-5bit --prompt "Solve 37 * 48 step by step." --enable-thinking

OpenAI-compatible local server:

mlx_vlm.server --model ressl/gemma-4-31B-it-uncensored-MLX-5bit --host 127.0.0.1 --port 8080

Quality and limitations

• The language model weights use 5-bit affine quantization with group size 64. Quantization can reduce quality compared with BF16.
• The vision tower and vision embedding path remain BF16 in every MLX release.
• The smoke suite verifies deterministic arithmetic, capitals, German, multi-turn memory, thinking mode, image understanding, basic output health, and measured runtime statistics.
• This checkpoint inherits the source model's limitations and may hallucinate or follow malicious instructions.
• No benchmark result should be generalized beyond the exact prompts, software, and hardware used for the measured run.

Provenance

The checkpoint was converted from commit 64c863e92fc131e5f4b0fe3631a0791fe2c19152. Quantized releases use affine MLX quantization with group size 64 for language weights. Modules whose path contains vision_tower or embed_vision are excluded from quantization. The BF16 release performs no weight quantization.

The original Gemma architecture and weights are provided by Google under the Apache License 2.0. This MLX conversion and the uncensored source release are maintained by Robert Ressl (Hugging Face, Website, LinkedIn, Patreon).

If this work is useful, you can support continued independent model research on Patreon.