This model is a fine-tuned version of distilbert/distilbert-base-uncased model and second iteration over tashrifmahmud/sentiment_analysis_model on IMDB and "Rotten Tomatoes" dataset. It achieves the following results on the evaluation set (model has been updated at epoch 1):
This model is a fine-tuned version of the DistilBERT transformer architecture for sentiment analysis. It was trained on the IMDB dataset for binary classification, distinguishing between positive and negative sentiment in movie reviews. The model has been further fine-tuned on the Rotten Tomatoes dataset to improve its generalization and performance on movie-related text.
Intended uses:
This model is suitable for classifying the sentiment of text, particularly movie reviews. It can be used in various applications such as: Sentiment analysis for social media posts, customer reviews, or product feedback. Analyzing movie reviews, comments, or related textual data. As part of a sentiment-aware recommendation system, content moderation tool, or market research.
Limitations:
The model is specifically tuned for movie-related sentiment analysis. Its performance on non-movie-related text (e.g., general product reviews, news articles) may not be optimal. The model may not perform well on texts with highly domain-specific terminology outside of movie-related contexts. This model may struggle with sarcasm, irony, and nuanced expressions of sentiment, as is typical with many sentiment analysis models.
Training data:
Test data from Rotten Tomatoes: The model's evaluation was performed using the test set of the Rotten Tomatoes dataset to assess its ability to generalize to unseen movie reviews.
Improvement Metrics after fine-tuning on Rotten Tomatoes:
The following hyperparameters were used during training:
As we can see, after Epoch 1.0 the Loss goes up indicating overfitting and thus the best model of Epock 1.0 (checkpoint-534) is pushed on the hub.
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 |
|---|---|---|---|---|---|---|---|
| 0.365 | 1.0 | 534 | 0.3682 | 0.8396 | 0.8267 | 0.8593 | 0.8427 |
| 0.2804 | 2.0 | 1068 | 0.3892 | 0.8452 | 0.8525 | 0.8349 | 0.8436 |
| 0.2301 | 3.0 | 1602 | 0.4342 | 0.8443 | 0.8404 | 0.8499 | 0.8451 |
model.safetensors 268 MBtraining_args.bin 5.3 kBtashrifmahmud/sentiment_analysis_model