lunyoro-nllb_en2lun

Fine-tuned NLLB-200 model for English → Lunyoro/Rutooro translation.

Lunyoro-Rutooro is a Bantu language spoken by the Bunyoro-Kitara and Tooro kingdoms in western Uganda.

Model Details

• Base model: facebook/nllb-200-distilled-600M
• Fine-tuned on: ~53,948 English-Lunyoro sentence pairs
• Training: 10 epochs, AdamW optimizer, cosine LR schedule
• Hardware: NVIDIA GPU (CUDA)
• Source language code: eng_Latn
• Target language code: run_Latn

Dataset

The training data was compiled from:

• Crowd-sourced word and sentence submissions
• Runyoro-Rutooro dictionary entries (Excel)
• Parallel sentence corpora
• Back-translation augmentation (~53,948 total pairs, quality-filtered)

Usage

from transformers import NllbTokenizer, AutoModelForSeq2SeqLM

model_name = "keithtwesigye/lunyoro-nllb_en2lun"
tokenizer = NllbTokenizer.from_pretrained(model_name)
model = AutoModelForSeq2SeqLM.from_pretrained(model_name)

tokenizer.src_lang = "eng_Latn"
text = "How are you?"
inputs = tokenizer(text, return_tensors="pt", truncation=True)
output = model.generate(
    **inputs,
    forced_bos_token_id=tokenizer.convert_tokens_to_ids("run_Latn"),
    num_beams=4,
    max_length=256
)
print(tokenizer.decode(output[0], skip_special_tokens=True))

Related Models

Full Application

Source code: chriskagenda/TRANSLATOR