Flint 40B for TokenWing
Flint (by Recursive) in the layout TokenWing streams from your SSD, so this 40B mixture-of-experts coding model runs fast on ordinary PCs.
The easiest way to use it is the Run My AI app: it downloads this model and sets everything up for your PC.
- Weights: Unsloth's UD-Q4_K_XL quantization (unsloth/flint-GGUF), unchanged; the file's layout is changed so experts can be read straight from the SSD, and TokenWing's data for this model is added to it.
- License: Apache 2.0, as the original model (a copy is in LICENSE). Credit: Recursive, and Unsloth for the quantization.