This repository contains GGUF format quantizations of the model reaperdoesntknow/LFM2.5-8B-A1B-Opus-Distil.
Compatible with llama.cpp, LM Studio, Ollama, Jan, KoboldCpp, and any GGUF-capable runtime.
🧠 What this model does The base fine-tune was distilled on angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k, a dataset of reasoning traces from Claude Opus 4.6/4.7. This means the model:
✅ Produces structured ... reasoning blocks before answering
✅ Generates well-formatted Markdown responses (headers, lists, LaTeX)
✅ Follows a deliberative, step-by-step explanation style
⚠️ May hallucinate citations, dates, and references (the style is distilled, not the underlying knowledge base — see model card for full limitations)
⚙️ Recommended generation parameters Inherited from the source model:
Parameter Value temperature 0.7 top_p 0.95 repetition_penalty 1.05 max_new_tokens 1024+ (reasoning traces are long)
⚠️ Limitations Inherited from the base fine-tune:
May hallucinate facts, citations, dates, or source attributions May overproduce reasoning traces when shorter answers are preferred Not benchmarked against safety, factuality, coding, math, or instruction-following suites Sparse adaptation may leave some base-model capabilities unchanged while modifying others unevenly Not intended for medical, legal, financial, or safety-critical use without human verification See the source model card for the full safety and intended-use disclaimer.
📜 License Apache 2.0, inherited from the source model.
🙏 Credits Liquid AI — base architecture and pretrained weights (LFM2.5-8B-A1B) reaperdoesntknow / Convergent Intelligence LLC — Opus-Distil fine-tune with the CIxOpt optimizer angrygiraffe — Claude Opus reasoning dataset ggerganov/llama.cpp — GGUF format and quantization tools
📚 Citation If you use this work, please cite the upstream sources:
bibtex
@misc{liquidai_lfm25, title = {LFM2.5-8B-A1B}, author = {Liquid AI}, year = {2025}, publisher = {Hugging Face}, url = (https://huggingface.co/LiquidAI/LFM2.5-8B-A1B) }
@misc{opus_distil_2025, title = {LFM2.5-8B-A1B-Opus-Distil}, author = {Convergent Intelligence LLC}, year = {2025}, publisher = {Hugging Face}, url = (https://huggingface.co/reaperdoesntknow/LFM2.5-8B-A1B-Opus-Distil) }