sentseg-camelbert-NoPnx-NP

Model Description

sentseg-camelbert-NoPnx-NP is an Arabic sentence segmentation model built by fine-tuning CAMeLBERT-MSA on the No-Punctuation No-Paragraph (NoPnx-NP) variant of AraSeg, a manually annotated, genre-diverse Arabic sentence segmentation benchmark covering 8 genres.

Sentence segmentation is framed as binary token classification: for every word, the model predicts whether a sentence boundary follows it.

---

Task Variant

No-Punctuation No-Paragraph (NoPnx-NP): Punctuation, source-specific boundary markers (e.g. verse numbers, multiple-choice labels) and paragraph boundaries are removed, so each document is one stream of unpunctuated tokens.

AraSeg defines four task variants, each with its own model:

---

Labels

The label of a word is predicted on its last subtoken.

---

Training

• Base model: CAMeL-Lab/bert-base-arabic-camelbert-msa (the tokenizer is unchanged).
• Data: the train split of the NoPnx-NP config of MBZUAI/AraSEG.
• Hyperparameters: effective batch size 32, 5 epochs, learning rate 3e-5.
• Long inputs: sequences are processed in 512-token windows with a stride of 64; logits of overlapping windows are averaged.

---

Evaluation

Boundary precision (P), recall (R) and F1 on AraSeg. A predicted boundary is correct only if it exactly matches a gold boundary; scores are computed per document and macro-averaged over documents.

---

Citation

If you use this model in your work, please cite the following paper:

@inproceedings{elkholy-etal-2026-arabic-sentence-segmentation,
    title = "{A}rabic Sentence Segmentation Across Genres and Punctuation Conditions",
    author = "Elkholy, Mohammed and
      Elmadani, Khalid N. and
      Habash, Nizar and
      Alhafni, Bashar",
    booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2026",
    month = oct,
    year = "2026",
    address = "Budapest, Hungary",
    publisher = "Association for Computational Linguistics"
}