Try LFM • Docs • LEAP • Discord

LFM2-700M-GGUF

LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency.

Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2-700M

🏃 How to run LFM2

Example usage with llama.cpp:

llama-cli -hf LiquidAI/LFM2-700M-GGUF --conversation \
    --temp 0.3 --min-p 0.15 --repeat-penalty 1.05