Bashkir-Russian Pair Scorer

Compact ONNX models that score whether a Bashkir-Russian sentence pair is parallel, for fast corpus filtering.

Overview

Compact ONNX models for estimating whether a Bashkir-Russian sentence pair is parallel and suitable for corpus filtering. The release is designed for fast, repeatable scoring of large bilingual corpora and contains three model sizes: nano, mini and medium. This is an alignment-quality scorer, not a translation model: it returns a compatibility score for a pair of texts and can be used to build a filtering cascade.

Contents

Files and Configurations

All configurations use the same SentencePiece vocabulary and the fast128 profile: FP16 weights, dynamic batch dimension and a maximum of 128 tokens per side. This is a deliberate production design for stable speed and predictable memory use; longer inputs are truncated before scoring.

Model Architecture

Examples

Scores from the medium model on CPU (Sigmoid of score_logit):

Method

reviewed parallel data + hard negatives + teacher signals
  ├── 1. construct cross-encoder input pairs (ba + ru)
  ├── 2. train compact cross-encoder with margin-calibrated distillation
  ├── 3. optimize inference graphs with fast128 sequence profiling
  └── 4. export ONNX family: nano, mini & medium (FP16 & INT8)

The models were trained for Bashkir-Russian parallel-corpus quality estimation using reviewed parallel data, hard negative pairs and teacher/reference scoring signals. The release contains model weights and tokenizer assets only; the source corpus text is not included.

Benchmark

Comparison on a calibrated bilingual evaluation set (10,000 positive pairs and 20,000 deterministic global/local hard negatives, excluded from training). Full numbers are in benchmark_summary.json.

The compact scorers trade a small amount of discrimination for a large throughput gain. A practical cascade is nano/mini for the first pass, medium for uncertain pairs and LaBSE/LASER only for the final review layer.

Quality and Use

Scores are not calibrated human probabilities. The accepted, review and quarantine thresholds must be calibrated for a target corpus and a reviewed sample. The fast128 profile truncates long inputs; for long literary or document segments use a review layer with a longer-context scorer.

Limitations

• Alignment scores are model estimates, not human judgments.
• The benchmark is intended for comparison and does not guarantee production precision on every domain.
• fast128 truncates inputs beyond 128 tokens per side.
• Starting thresholds are heuristics and require per-corpus calibration.

Related Resources

• Bashkir-Russian Wikipedia Parallel Corpus — uses the medium model to produce its pair_score column, a concrete application of this scorer.

Usage

pip install onnxruntime sentencepiece numpy

import numpy as np
import onnxruntime as ort
import sentencepiece as spm

session = ort.InferenceSession(
    "models/mini/model.onnx",
    providers=["CUDAExecutionProvider", "CPUExecutionProvider"],
)
tokenizer = spm.SentencePieceProcessor(model_file="spm_bpe_16k.model")


def encode(ba, ru, max_len=128):
    limit = (max_len - 3) // 2
    ru_ids = tokenizer.encode(ru, out_type=int)[:limit]
    ba_ids = tokenizer.encode(ba, out_type=int)[:limit]
    ids = [1, *ru_ids, 2, *ba_ids, 2]
    ids += [tokenizer.pad_id()] * (max_len - len(ids))
    ids = np.asarray([ids], dtype=np.int64)
    return {"input_ids": ids, "attention_mask": ids != tokenizer.pad_id()}


logit = session.run(["score_logit"], encode("Сәләм донъя", "Привет мир"))[0][0]
score = float(1 / (1 + np.exp(-logit)))
print(score)

For corpus-scale jobs, use the direct batch runner to avoid HTTP/JSON overhead and stream Parquet, CSV/TSV or JSONL inputs.

License

Distributed under the Apache-2.0 license. This release contains derived alignment-scoring software and model assets, not source corpus text, scans or original page layouts.

Citation

@software{failed09_bashkir_pair_scorer_2026,
  title = {Bashkir-Russian Pair Scorer},
  author = {failed09},
  year = {2026},
  publisher = {Hugging Face},
  url = {https://huggingface.co/failed09/bashkir-pair-scorer},
  note = {Open-source compact alignment models for the Bashkir language}
}

Open Bashkir Data and Sources 🐝

This release is part of an open-source effort to support the development, preservation and practical use of the Bashkir language. Other related models, datasets and tools are available on the author's Hugging Face profile.

The author does not claim ownership or authorship of the source texts or other materials used to derive this release; rights and licensing remain with the original authors, publishers and dataset providers. Source texts are not redistributed in this repository, so users should follow the licenses and attribution requirements of the relevant upstream resources.