MsgSense SMS Classifier

This model predicts a composite label in the format:

<score>_<sms_type_id>

• score (first digit): message importance used by app policy.
• sms_type_id (second part): category id from SmsClassificationTypeEntity mapping.

Input Format

Sender: <clean_address> | Message: <normalized body>

Output Decoding

Example output label: 3_37

• score = 3
• sms_type_id = 37 (SERVICE_NOTIFICATION)

Usage

from transformers import pipeline

pipe = pipeline(
    "text-classification",
    model="imShub10/msgsense-sms-distilbert-cleanaddr-fulldata-20260424",
)

text = "Sender: DAIKIN | Message: Your service request is scheduled."
print(pipe(text))

DistilBERT

• accuracy: 0.95188
• f1 (weighted): 0.95205
• f1_macro: 0.92125
• precision: 0.95353
• recall: 0.95188
• test_loss: 0.31780
• train_loss: 0.02321
• training_time_min: 34.0
• model_size_mb: 256.2