sentseg-camelbert-NoPnx-PA

Model Description

sentseg-camelbert-NoPnx-PA is an Arabic sentence segmentation model built by fine-tuning CAMeLBERT-MSA on the No-Punctuation Paragraph-Aware (NoPnx-PA) variant of AraSeg, a manually annotated, genre-diverse Arabic sentence segmentation benchmark covering 8 genres.

Sentence segmentation is framed as binary token classification: for every word, the model predicts whether a sentence boundary follows it.

---

Task Variant

No-Punctuation Paragraph-Aware (NoPnx-PA): Punctuation and source-specific boundary markers are removed; paragraph boundaries are kept and each paragraph is segmented on its own.

AraSeg defines four task variants, each with its own model:

---

Labels

The label of a word is predicted on its last subtoken.

---

Training

• Base model: CAMeL-Lab/bert-base-arabic-camelbert-msa (the tokenizer is unchanged).
• Data: the train split of the NoPnx-PA config of MBZUAI/AraSEG.
• Hyperparameters: effective batch size 32, 5 epochs, learning rate 3e-5.
• Long inputs: sequences are processed in 512-token windows with a stride of 64; logits of overlapping windows are averaged.

---

Evaluation

Boundary precision (P), recall (R) and F1 on AraSeg. A predicted boundary is correct only if it exactly matches a gold boundary; scores are computed per document and macro-averaged over documents.

---

Citation

If you use this model in your work, please cite the following paper:

@inproceedings{elkholy-etal-2026-arabic-sentence-segmentation,
    title = "{A}rabic Sentence Segmentation Across Genres and Punctuation Conditions",
    author = "Elkholy, Mohammed and
      Elmadani, Khalid N. and
      Habash, Nizar and
      Alhafni, Bashar",
    booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2026",
    month = oct,
    year = "2026",
    address = "Budapest, Hungary",
    publisher = "Association for Computational Linguistics"
}