DroidSenior-7B

DroidSenior-7B is a 7B coding assistant specialized in Android development, fine-tuned from Qwen2.5-Coder-7B-Instruct. It aims to answer like a senior/staff Android engineer: modern idiomatic Kotlin, Jetpack Compose, Coroutines/Flow, Hilt and Room, the official Android architecture guidance, explicit trade-offs, no deprecated APIs and tests where they add value. It answers in English and Turkish.

• Weights for transformers / vLLM: this repo
• GGUF for Ollama / LM Studio / llama.cpp: celebibasar/DroidSenior-7B-GGUF

Recommended system prompt

The model was trained with this system prompt on its highest-quality data. Use it for best results:

You are DroidSenior, a staff-level Android engineer. Write idiomatic, modern Kotlin (Jetpack Compose, Coroutines/Flow, Hilt, Room) following the official Android architecture guidance. Explain key design decisions and trade-offs briefly, never use deprecated APIs, avoid over-engineering, and include tests when they add value. Answer in the user's language.

Quick start

transformers

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "celebibasar/DroidSenior-7B"
SYSTEM_PROMPT = """You are DroidSenior, a staff-level Android engineer. Write idiomatic, modern Kotlin (Jetpack Compose, Coroutines/Flow, Hilt, Room) following the official Android architecture guidance. Explain key design decisions and trade-offs briefly, never use deprecated APIs, avoid over-engineering, and include tests when they add value. Answer in the user's language."""

tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, torch_dtype="auto", device_map="auto")

messages = [
    {"role": "system", "content": SYSTEM_PROMPT},
    {"role": "user", "content": "Implement a paginated list screen with Compose, Room and Paging 3."},
]
text = tok.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tok(text, return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=1500, do_sample=True, temperature=0.3, top_p=0.9)
print(tok.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))

vLLM (OpenAI-compatible server)

vllm serve celebibasar/DroidSenior-7B --max-model-len 16384

Ollama

ollama run hf.co/celebibasar/DroidSenior-7B-GGUF:Q4_K_M

For the recommended system prompt, download Modelfile and the GGUF file from the GGUF repo and run ollama create droid-senior -f Modelfile.

Training

1. Open data: Android/Kotlin examples from public Hugging Face datasets, filtered for Android relevance, Java-only answers, deprecated APIs (AsyncTask, GlobalScope, kapt, synthetics, ...) and near-duplicates.
2. Senior distillation: a taxonomy of 12 areas x 9 task types (feature implementation, code review, legacy refactoring, architecture decisions, debugging, testing, performance, deep dives, system design). A teacher model (Qwen/Qwen3-Coder-30B-A3B-Instruct-FP8) generated realistic questions and answered them with a detailed staff-engineer prompt.
3. Judge filtering: every answer scored on correctness, modernity, architecture, code quality, completeness and clarity; only high-scoring answers were kept.
4. SFT: LoRA (bf16) on all attention and MLP projections, loss on assistant tokens only. Senior data used the system prompt above; open data used a generic prompt (quality conditioning).
5. DPO: on-policy preference tuning — the SFT model sampled 4 answers per prompt, the judge picked the best/worst (654 pairs, beta=0.1, lr=5e-06, LoRA r=32).

Data

Hyperparameters

Evaluation

Evaluated on 150 held-out questions (never used in training), scored 1-10 by Qwen/Qwen3-Coder-30B-A3B-Instruct-FP8 with the same rubric for every model.

Head-to-head vs. the base model (overall score per question):

Caveats: LLM-as-judge scores, judged by the same model family that generated the training data, on questions drawn from the same generator distribution. Treat them as a relative signal, not an absolute benchmark.

Limitations

• 7B model: it can still produce code that does not compile or uses APIs incorrectly. Review generated code.
• Knowledge of libraries is limited to what the base model and training data contain; very recent APIs may be missing.
• Training data is largely synthetic and judged by an LLM; it inherits the teacher's biases and mistakes.

License

Released under apache-2.0. Base model: Qwen2.5-Coder-7B-Instruct (Apache-2.0). Training data includes non-commercially licensed sets (JetBrains/KExercises); check their terms before commercial use.