Suvir-Misra/Gemma-3-270M-IndicLegalQA-GGUF

来源：🤗有风险🏴‍☠️ 救援者：isilicontext-generationapache-2.0368 MBGGUF✓ 3 个校验和4 天前更新

Gemma-3-270M-IndicLegalQA-GGUF

Fine-tuned Google Gemma 3 (270M parameters) optimized for Indian Law, Supreme Court of India Jurisprudence, statutory codes (Bharatiya Nyaya Sanhita 2023 / BNSS 2023 / IPC / CrPC), Constitutional Law, General Legal Reasoning, and GST / Tax Law.

This model integrates the IndicLegalQA dataset (10,000 Supreme Court QA pairs, DOI: 10.17632/gf8n8cnmvc) using a balanced multi-task curriculum, Stochastic Weight Averaging (SWA), and Weight Subspace Orthogonalization (WSO) attention calibration.

Model Details

Base Model: google/gemma-3-270m-it
Architecture: Gemma 3 Causal LM (18 layers, sliding window attention, 640 hidden size, 262,144 vocab)
Fine-Tuning Framework: MLX LoRA (800 iterations, validation loss: 0.792)
Optimization Strategy: SWA across checkpoints 500–800 + WSO attention calibration ($s_{qk}=1.002, s_{vo}=1.000$)
Quantization: GGUF (F16, Q8_0, Q4_K_M)

Provided Files

File	Precision / Quant	Size	Recommended Use
`gemma-3-270m-it-indiclegalqa-q8_0.gguf`	Q8_0	448 MB	Recommended for Ollama and high-fidelity inference
`gemma-3-270m-it-indiclegalqa-q4_k_m.gguf`	Q4_K_M	351 MB	Low-memory edge devices and micro-instances
`gemma-3-270m-it-indiclegalqa-f16.gguf`	F16	838 MB	Full precision master weights

Key Benchmark Outputs

Query	Gemma 3 270M IndicLegalQA Output
Minerva Mills v. Union of India (1980)	Struck down clauses (4) & (5) of Article 368; held harmony and balance between Fundamental Rights (Part III) and Directive Principles (Part IV) is an essential feature of the Basic Structure.
Child Criminal Immunity Age	Absolute immunity (Doli Incapax) under 7 years (Section 20 BNS / Section 82 IPC); qualified immunity for 7–12 years (Section 21 BNS / Section 83 IPC).
Murder Section under BNS 2023	Section 103(1) for murder; Section 103(2) specifically for mob lynching.
Community Service under BNS 2023	Statutory punishment introduced under Section 4(f) for 6 petty offenses (theft <₹5k, defamation, drunken misconduct, etc.).
Vishakha Guidelines Year	Promulgated in 1997 (Vishaka v. State of Rajasthan) under Articles 14, 19, and 21 before enactment of the POSH Act, 2013.
Maxim: Actus non facit reum nisi mens sit rea	"An act does not make a person guilty unless the mind is also guilty" (Actus Reus + Mens Rea).
Prerogative Writ for Jurisdiction	Writ of Prohibition (preventive) contrasted with Certiorari (curative).
Natural Justice	Procedural fairness comprising Nemo judex in causa sua (rule against bias) and Audi alteram partem (rule of fair hearing).

Quickstart with Ollama

Download the gemma-3-270m-it-indiclegalqa-q8_0.gguf file and Modelfile.
Create and run the model in Ollama:

ollama create gemma-3-270m-legal -f Modelfile
ollama run gemma-3-270m-legal

Recommended Inference Parameters

PARAMETER num_ctx 2048
PARAMETER repeat_penalty 1.0
PARAMETER stop <end_of_turn>
PARAMETER stop <eos>
PARAMETER temperature 0.1
PARAMETER top_p 0.95

Note on Repetition Penalty: In compact legal models, keep repeat_penalty 1.0 to avoid penalizing prompt-echoing statutory numbers or section citations.

Dataset & Training Methodology

IndicLegalQA Dataset: 10,000 Supreme Court question-answer pairs curated by Mendeley Data / Kaggle (DOI: 10.17632/gf8n8cnmvc).
Foundational Legal Curriculum: Balanced statutory mappings across Bharatiya Nyaya Sanhita (BNS), BNSS, Indian Penal Code, Code of Criminal Procedure, Constitution of India, GST, and Income Tax.
Dialogue Dynamics: Incorporates multi-turn legal consultation pairs to maintain conversational stability across consecutive turns.