Qwen3 0.6B 4-bit Core AI example

This repository contains a macOS Core AI .aimodel export of Qwen/Qwen3-0.6B, prepared for Apple-silicon Golden Gate (macOS 27) examples in MeshLLM.

It is a converted resource bundle, not the original SafeTensors checkpoint. The artifact uses Apple's 4-bit weight-only export with per-block block size 32 and an 8,192-token context limit. It requires Apple's Core AI runtime and cannot be loaded by llama.cpp, Transformers, or non-Apple hosts.

Use with MeshLLM

Download the repository on an Apple-silicon Mac with Golden Gate and point the experimental Apple provider at the downloaded resource directory:

hf download meshllm/qwen3-0.6b-4bit-aimodel \
  --local-dir target/apple-runtime/models/qwen3-0.6b-4bit-aimodel

export MESH_APPLE_COREAI_MODEL_ROOT="$PWD/target/apple-runtime/models/qwen3-0.6b-4bit-aimodel"
export MESH_APPLE_COREAI_MODEL_ID="apple/coreai/qwen3-0.6b"
export MESH_APPLE_COREAI_MODEL_VERSION="qwen3-0.6b-4bit-coreai"
export MESH_APPLE_COREAI_CONTEXT_SIZE=8192
export MESH_APPLE_COREAI_LANGUAGES=en
just apple::run serve --port 11435

The preparation manifest records the exact source revision, exporter revision, toolchain versions, and SHA-256 inventories used to produce this bundle.

Attribution and license

The source model is Qwen3 0.6B by Qwen and is distributed under the Apache License 2.0. The source revision used for this export is c1899de289a04d12100db370d81485cdf75e47ca. See LICENSE and the upstream model card for the full terms.

This converted artifact is provided as an experimental interoperability example. Apple Core AI and macOS are trademarks of Apple Inc.; this repository is not an Apple product or endorsement.