Flint INT4
MLX-format INT4 weights for Recursive Flint, primarily intended for local inference on Apple Silicon. Projections and experts use group-64 affine INT4; embeddings use INT8. The weights occupy approximately 22.6 GB.
See Flint’s model card for model details, benchmarks, chat conventions, and limitations.
Use with Rec
Follow Rec’s requirements and installation guide, then launch pi or OpenCode:
rec launch pi
# Or use OpenCode:
rec launch opencode
Download the weights separately
With the Hugging Face CLI installed:
hf download RecursiveSI/flint-int4 --local-dir flint-int4
For llama.cpp on Metal, use Flint INT4 GGUF.
Training data
Flint’s training data included publicly available and crawled web documents, text and code, commercially licensed data, and AI-generated synthetic data. Post-training included instruction tuning, reinforcement learning and human-preference data. See the base Flint model card for shared model and training information.