Supertron2-1.7B: A Compact, Efficient Instruction-Tuned Language Model

Model Description

Supertron2-1.7B is an instruction-tuned language model built on top of Qwen3-1.7B. Designed to be a reliable, efficient daily driver, it delivers strong performance across math, coding, reasoning, science, general knowledge, and general conversation while remaining lightweight enough to run on consumer hardware.

• Developed by: Surpem
• Model type: Causal Language Model
• Architecture: Dense Transformer, 1.7B parameters
• Fine-tuned from: Qwen/Qwen3-1.7B
• License: Apache 2.0

---

Capabilities

Reasoning

Supertron2-1.7B is designed for clear multi-step reasoning, making it capable of breaking down complex problems in a structured and useful way. It can work through questions methodically rather than jumping directly to a final answer.

Math

The model handles a range of math tasks, from arithmetic and algebra to word problems and structured problem solving. It is useful for explaining steps, checking calculations, and producing concise final answers.

Coding

Supertron2-1.7B can write, debug, and explain code across popular languages including Python, JavaScript, C++, and more. It understands syntax, common programming patterns, algorithmic reasoning, and practical implementation details.

Science & General Knowledge

Broad instruction tuning across science, STEM, and general knowledge domains means the model can hold technical conversations, explain difficult concepts clearly, and assist with research, writing, and analysis tasks.

Instruction Following

The model is responsive to natural language instructions. Whether you need concise answers, detailed explanations, structured output, or creative writing, Supertron2-1.7B adapts to the format and tone you ask for without needing complex prompting tricks.

---

Get Started

from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

model_id = "Surpem/Supertron2-1.7B"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto"
)

messages = [
    {"role": "user", "content": "Explain the difference between LoRA and full fine-tuning."}
]

text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=512)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))

---

Hardware Requirements

For 4-bit quantized inference:

from transformers import BitsAndBytesConfig

bnb_config = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_compute_dtype=torch.bfloat16)
model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config, device_map="auto")

---

Citation

@misc{surpem2026supertron2-1.7b,
      title={Supertron2-1.7B — Efficient Instruction-Tuned Language Model},
      author={Surpem},
      year={2026},
      url={https://huggingface.co/Surpem/Supertron2-1.7B},
}