amazon-LAR-27B-GGUF
LAR-27B is a 27-billion-parameter open-weights agentic language model developed by Amazon, post-trained from
Qwen/Qwen3.8-27B(Apache 2.0) on a license-filtered subset of theSWE-Rebenchdataset to solve complex, long-horizon software engineering and terminal-usage tasks. Moving beyond sparse outcome-only supervision, the model is trained with the Lean4AgenticRL framework, which grounds open-ended agentic reinforcement learning in a unified Lean 4 formalization schema. This methodology establishes problem-specific workflows and generates verifiable, multi-level process rewards—capturing low-level tool-call accuracy, mid-level workflow-stage progress, and high-level task outcomes—to guide policy updates via workflow-stage-normalized Group Relative Policy Optimization (GRPO). Through this formal, multi-granular reward structure, LAR-27B sets a strong benchmark for its parameter class, achieving 84.2% on SWE-Bench-Verified, 68.2% on TerminalBench-2.0, and 77.3% on TerminalBench-2.1.
[!NOTE] MTP — Speculative Decoding: No
Model Files
| File Name | Quant Type | File Size | File Link | Description |
|---|---|---|---|---|
| LAR-27B.BF16.gguf | BF16 | 53.8 GB | Link | Full BF16 weights. Highest quality, largest file size. |
| LAR-27B.Q3_K_L.gguf | Q3_K_L | 14.3 GB | Link | Lower quality but usable, good for low RAM availability. |
| LAR-27B.Q4_K_M.gguf | Q4_K_M | 16.5 GB | Link | Good quality, default size for most use cases, recommended. |
| LAR-27B.Q5_K_M.gguf | Q5_K_M | 19.2 GB | Link | High quality, recommended. |
llama.cpp
LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp