✍️ SmolLM2-360M-GEC: High-Precision Grammar & Spelling Corrector

SmolLM2-360M-GEC is a lightweight, high-performance Grammatical Error Correction (GEC) and spelling correction model fine-tuned on top of HuggingFaceTB/SmolLM2-360M-Instruct.

Trained with completion-only loss masking on a curated multi-source corpus of ~290,000 real-world sentence pairs, it delivers state-of-the-art grammar, typo, syntax, and agreement corrections at a fraction of the computational footprint of industry models.

---

⚡ Key Highlights

• Ultra-Compact Footprint: At only 360M parameters (less than half the parameter count of grammarly/coedit-large's 770M), it requires only ~550 MB VRAM when running the included Q8_0 GGUF (LM Studio / llama.cpp) and ~950 MB VRAM for native FP16 PyTorch inference.
• Blazing Fast Throughput: Delivers 120 – 180+ tokens/sec with 100% GPU offload on consumer GPUs (e.g., GTX 1650, RTX 3060, Apple Silicon) and runs in ~1 second per sentence on CPU.
• Zero Hallucination / Anti-Overcorrection: Trained with clean identity anchors (source == target) ensuring 100% precision on already correct sentences without altering the user's intended meaning.
• Dual Distribution: Packaged with standard Hugging Face transformers safetensors and llama.cpp Q8_0 GGUF for instant deployment in LM Studio, Ollama, and local edge devices.

---

🥊 3-Way Model Comparison

We rigorously evaluated SmolLM2-360M-GEC side-by-side against its Base Model (SmolLM2-360M-Instruct) and Grammarly's Industry Standard (grammarly/coedit-large, 770M Seq2Seq T5).

1. Architectural & Resource Profile

---

2. Empirical Benchmark Examples (Head-to-Head)

---

🚀 Quickstart Guide

1. Using Hugging Face transformers

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "SupratimRK/SmolLM2-360M-GEC"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.float16 if torch.cuda.is_available() else torch.float32,
    device_map="auto" if torch.cuda.is_available() else None,
)

SYSTEM_PROMPT = (
    "You are an expert grammar and spelling correction assistant. "
    "Fix all grammatical, spelling, and punctuation errors. "
    "Output only the corrected sentence without any explanation."
)

def correct_grammar(text: str) -> str:
    messages = [
        {"role": "system", "content": SYSTEM_PROMPT},
        {"role": "user", "content": text.strip()}
    ]
    prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
    inputs = tokenizer(prompt, return_tensors="pt").to(model.device)

    with torch.no_grad():
        outputs = model.generate(
            **inputs,
            max_new_tokens=128,
            do_sample=False,              # Deterministic greedy decoding
            pad_token_id=tokenizer.eos_token_id,
            eos_token_id=[tokenizer.eos_token_id, tokenizer.convert_tokens_to_ids("<|im_end|>")]
        )
    
    decoded = tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True)
    return decoded.strip()

# Test
print(correct_grammar("she go to school yesterday and buyed apples"))
# Output: She went to school yesterday and bought apples.

print(correct_grammar("Their going to there house over they're."))
# Output: They are going to their house over there.

---

2. Running in LM Studio (GGUF)

1. Download smollm2_gec_v1.5.gguf directly from the Files and versions tab.
2. Place it into your LM Studio models directory:

   ~/.cache/lm-studio/models/SupratimRK/SmolLM2-360M-GEC/smollm2_gec_v1.5.gguf
   

3. Load the model and configure:
   • GPU Offload: Set to MAX (32 layers) (uses ~550 MB VRAM).
   • Chat Template: Select ChatML (or paste the Jinja template below).
   • System Prompt:

     You are an expert grammar and spelling correction assistant. Fix all grammatical, spelling, and punctuation errors. Output only the corrected sentence without any explanation.
     

   • Temperature: 0.0 (Greedy decoding for deterministic grammar correction).
   • Stop Tokens: <|im_end|>, <|endoftext|>.

---

3. LM Studio Jinja2 Chat Template

{% for message in messages %}
{% if loop.first and messages[0]['role'] != 'system' %}
{{ '<|im_start|>system\nYou are an expert grammar and spelling correction assistant. Fix all grammatical, spelling, and punctuation errors. Output only the corrected sentence without any explanation.<|im_end|>\n' }}
{% endif %}
{{ '<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>\n' }}
{% endfor %}
{% if add_generation_prompt %}
{{ '<|im_start|>assistant\n' }}
{% endif %}

---

🔬 Training Methodology

• Base Model: HuggingFaceTB/SmolLM2-360M-Instruct
• Fine-Tuning Paradigm: LoRA (Low-Rank Adaptation)
  • Rank ($r$): 16 | Alpha ($\alpha$): 32 | Dropout: 0.05
  • Target Modules: All linear projections (q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj)
• Loss Masking Strategy: Completion-Only Loss Masking. Loss is computed strictly over the corrected target tokens; all system instructions and user input prompt tokens are assigned a loss label of -100.
• Training Corpus: ~290,000 multi-domain gold sentence pairs:
  1. grammarly/coedit (GEC Task)
  2. Cambridge W&I-LOCNESS Detokenized ESL Corpus
  3. agentlans/grammar-correction Syntactic Corpus
  4. ProCreations/Mistake-To-Meaning Keyboard & OCR Typos
  5. guychuk/typos-misspellings-homophones Confusable Words
  6. Clean Identity Invariance Anchors (source == target)

---

📄 License & Attribution

This model is licensed under the Apache 2.0 License, inherited from the foundational SmolLM2 architecture. You are free to use, modify, and integrate this model into commercial and personal applications.

---

Developed and fine-tuned by SupratimRK | Built on SmolLM2 by Hugging Face