🚀 LFM 3 1.7B Claude Distill
An enhanced, lightweight code-reasoning model built on top of LiquidAI's LFM-3 1.7B. Fine-tuned to improve code performance and reasoning.
📌 Quick Summary
| Feature | Details |
|---|---|
| Developed by | Schnuckade |
| Base Model | LiquidAI/LFM3-1.7B |
| Fine-Tuning Framework | Unsloth 🦥 |
| Datasets Used | Various datasets distilled from Claude |
| License | Apache-2.0 |
| Language | English |
💡 About the Model
LFM-3-Coder-Claude-Distill is a fine-tune designed to improve the model's reasoning and coding abilities. It was distilled on traces generated by Sonnet, Opus and Fable to better mimic their reasoning and answer style.
- 🧠 Reasoning Focus: Helps the model think through problems step-by-step.
- ⚡ Lightweight & Efficient: Reaches 200+ tokens/s on an RTX 4060.
- 📦 Multi-Format: Includes full FP16/BF16 safetensors alongside quantized GGUF weights (
Q4_K_M) for easy local deployment.
🛠️ Usage & Integration
Transformers / Unsloth
from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
model_name = "Schnuckade/LFM-3-Coder-Claude-Distill",
max_seq_length = 4096,
load_in_4bit = True,
)