This model predicts the punctuation of Catalan language.
The model restores the following punctuation markers: "." "," "?" "-" ":"
Based on the work https://github.com/oliverguhr/fullstop-deep-punctuation-prediction
The performance differs for the single punctuation markers as hyphens and colons, in many cases, are optional and can be substituted by either a comma or a full stop. The model achieves the following F1 scores for Catalan language:
| Label | CA |
|---|---|
| 0 | 0.99 |
| . | 0.93 |
| , | 0.82 |
| ? | 0.76 |
| - | 0.89 |
| : | 0.64 |
| macro average | 0.84 |
Softcatalà's contributions to this model are licensed under the MIT License.
The punctuation prediction approach is based on FullStop, whose source code is licensed under MIT.
The pretrained checkpoint identified in config.json is
BSC-TeMU/roberta-base-ca,
developed by the Barcelona Supercomputing Center and licensed under
Apache License 2.0. This checkpoint was fine-tuned for
Catalan punctuation prediction. Its Apache-2.0 terms continue to apply to the
underlying pretrained model; the MIT license covers Softcatalà's contributions.
Jordi Mas jmas@softcatala.org
pytorch_model.bin 502 MBtraining_args.bin 3.1 kB