sem-sem
source group: Semitic languages
target group: Semitic languages
OPUS readme: sem-sem
model: transformer
source language(s): apc ara arq arz heb mlt
target language(s): apc ara arq arz heb mlt
model: transformer
pre-processing: normalization + SentencePiece (spm32k,spm32k)
a sentence initial language token is required in the form of
>>id<<(id = valid target language ID)download original weights: opus-2020-07-27.zip
test set translations: opus-2020-07-27.test.txt
test set scores: opus-2020-07-27.eval.txt
Benchmarks
| testset | BLEU | chr-F |
|---|---|---|
| Tatoeba-test.ara-ara.ara.ara | 4.2 | 0.200 |
| Tatoeba-test.ara-heb.ara.heb | 34.0 | 0.542 |
| Tatoeba-test.ara-mlt.ara.mlt | 16.6 | 0.513 |
| Tatoeba-test.heb-ara.heb.ara | 18.8 | 0.477 |
| Tatoeba-test.mlt-ara.mlt.ara | 20.7 | 0.388 |
| Tatoeba-test.multi.multi | 27.1 | 0.507 |
System Info:
hf_name: sem-sem
source_languages: sem
target_languages: sem
opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/sem-sem/README.md
original_repo: Tatoeba-Challenge
tags: ['translation']
languages: ['mt', 'ar', 'he', 'ti', 'am', 'sem']
src_constituents: {'apc', 'mlt', 'arz', 'ara', 'heb', 'tir', 'arq', 'afb', 'amh', 'acm', 'ary'}
tgt_constituents: {'apc', 'mlt', 'arz', 'ara', 'heb', 'tir', 'arq', 'afb', 'amh', 'acm', 'ary'}
src_multilingual: True
tgt_multilingual: True
prepro: normalization + SentencePiece (spm32k,spm32k)
url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/sem-sem/opus-2020-07-27.zip
url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/sem-sem/opus-2020-07-27.test.txt
src_alpha3: sem
tgt_alpha3: sem
short_pair: sem-sem
chrF2_score: 0.507
bleu: 27.1
brevity_penalty: 0.972
ref_len: 13472.0
src_name: Semitic languages
tgt_name: Semitic languages
train_date: 2020-07-27
src_alpha2: sem
tgt_alpha2: sem
prefer_old: False
long_pair: sem-sem
helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535
transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b
port_machine: brutasse
port_time: 2020-08-21-14:41