How to Run Ripple-65B Preview Locally

The first GGUF of Ricursive's Ripple-65B Preview. We wrote its llama.cpp support, merged upstream in b12167. Built from ricursiveAI's original BF16 weights.

• Built by the team behind Atomic Chat, the app that runs open-weight models locally and offline.
• Runs on stock llama.cpp b12167 or newer, no patch: Ripple support was merged in PR #31692. Apps that bundle an older llama.cpp, LM Studio and Ollama among them, load these files once they move to b12167 or newer.

---

Ripple-65B Preview is a 65B dense model trained from scratch by Ricursive Intelligence on 12T tokens, post-trained for agentic coding, Apache-2.0. This repo has GGUF files of it for llama.cpp.

Pick a file

AD (Atomic Dynamic) files use our per-tensor layouts, quantized with an importance matrix computed on the BF16 weights over our public 4.7M-token calibration build, rendered with Ripple's own chat template. File names are Ripple-65B-Preview-<name>.gguf; for a split file, point llama.cpp at the first part.

The suggested hardware leaves room for a moderate context; long contexts need more memory for the KV cache. "Same top token" is how often the file picks the same next token as the BF16 original; "mean KLD" is the KL divergence of its next-token distribution from BF16's. Both are measured with llama-perplexity on our 30-language neutral corpus (87 chunks of 4096 tokens), llama.cpp 9e2a04a with the port, 8x A100 40 GB.

At the size of the plain llama.cpp Q4_K_M (38.8 GB), AD-IQ4_XS (38.7 GB) has 2.5x lower mean KLD (0.0149 against 0.0380) and matches the original's token choice 95.6% of the time against 93.0%. AD-IQ3_S reaches the plain Q4_K_M's quality at 6.4 GB less. The plain file stays in the repo for now as the baseline.

AD-IQ1_M is a research file: a 1-bit-class layout that matches the original's token choice 76.8% of the time, below AD-IQ2_XXS (80.8%) for only 1.5 GB less.

Speed, one run: the plain Q4_K_M with llama-cli on 1x GH200 96 GB processes the prompt at 309 tokens/s and generates 40.6 tokens/s.

Run it

Use llama.cpp b12167 or newer: a release build for your platform, or from source:

git clone https://github.com/ggml-org/llama.cpp
cd llama.cpp
cmake -B build -DGGML_CUDA=ON          # Mac: drop -DGGML_CUDA=ON (Metal is on by default)
cmake --build build -j --config Release --target llama-server llama-cli

Then serve a file (the chat template with tools and <think> reasoning is embedded in it, so pass --jinja):

./build/bin/llama-server -m Ripple-65B-Preview-AD-Q4_K_M.gguf --jinja -c 32768 -ngl 99

Ricursive publishes no default sampling settings for the Preview.

These files were made and measured with llama.cpp 9e2a04a and our port (ricursive-port.patch, kept in this repo). The merged upstream support uses the same tensor names and keys, so the files load unchanged. Checked on b12167 built from source with no patch, 1x A100 40 GB: AD-IQ2_XXS loads in llama-server --jinja, answers a coding prompt and stops on its own, and makes a correct tool call.

llama.cpp support

We wrote llama.cpp's support for Ripple, and it was merged upstream in PR #31692 (first release: b12167). It adds the ricursive architecture: 80 blocks with four RMSNorms each (pre and post attention, pre and post FFN), per-head Q/K RMSNorm, an elementwise sigmoid gate on the attention output (g_proj), a value residual (each block's V input mixes the scaled token embeddings back in with a learned weight), sliding-window attention (1024 tokens, RoPE) on four blocks of five and full attention without positional encoding on the fifth, SwiGLU with the gate and up activations clamped at 20, and the embeddings scaled by sqrt(5120). No new ggml op.

How we checked it against Ricursive's own modeling_ricursive.py (fp32, transformers 4.57.6), with llama.cpp in F32 on the same token ids:

Also: test-llama-archs -a ricursive passes on CPU, and llama-server renders the chat template byte for byte like apply_chat_template (plain, system, multi-turn with reasoning, tools, parallel tool calls with results).

Model facts

Quantized by AtomicChat.