bert-text-classification-car-evaluation

This model is a fine-tuned version of distilbert/distilbert-base-uncased on the Car Evaluation Dataset. You can always find it here in Hugging Face Hub.

It achieves the following results on the evaluation set:

• Loss: 0.0090
• F1: 1.0
• Roc Auc: 1.0
• Accuracy: 1.0

Model description

The model is designed for text classification tasks on the Car Evaluation Dataset. It is a fine-tuned version of the DistilBERT model, aiming to predict car evaluation categories based on textual information.

Intended uses & limitations

Intended Uses

• Car evaluation category prediction based on textual information.
• Text classification tasks related to the car evaluation domain.

Limitations

• The model's performance is specifically tuned for the Car Evaluation Dataset; its generalization to other tasks or datasets might be
• limited.
• It may not perform optimally on text from different domains or with substantially different linguistic characteristics.

Training and evaluation data

The model was trained on the Car Evaluation Dataset, which includes textual descriptions of cars along with corresponding evaluation categories.

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 50
• early_stopping: 10

Training results

The model stopped training at the 29th epoch, achieving the following results on the evaluation set:

Framework versions

• Transformers 4.38.2
• Pytorch 2.2.1
• Datasets 2.18.0
• Tokenizers 0.15.2

Acknowledgments

This model is built upon the distilbert/distilbert-base-uncased pre-trained model and utilizes the Hugging Face Transformers library. Special thanks to the creators of the Car Evaluation Dataset for providing the training and evaluation data.

Contact Information

For any questions or inquiries, please contact the model developer:

Name: Henriquee

Hugging Face: Henriquee

License

This model is released under the MIT License. See the LICENSE file for more details.