cirimus/ultrabert-380M-bias-type-classifier

💡 This model is part of the collection Frontier BERT Workhorses.

Overview

This model was fine-tuned from UltraBERT-380M on a synthetic dataset of biased statements and questions, generated by Mistral 7B as part of the GUS-Net paper. The model is designed to identify and classify text bias into multiple categories, including racial, religious, gender, age, and other biases, making it a valuable tool for bias detection and mitigation in natural language processing tasks.

---

Model Details

• Base Model: UltraBERT-380M
• Fine-Tuning Dataset: Synthetic biased corpus
• Number of Labels: 11
• Problem Type: Multi-label classification
• Language: English
• License: Apache 2.0
• Fine-Tuning Framework: Hugging Face Transformers

---

Example Usage

Here’s how to use the model with Hugging Face Transformers:

# requires transformers>=5.2:  pip install -U "transformers>=5.2"
from transformers import pipeline

# Load the model
classifier = pipeline(
    "text-classification",
    model="cirimus/ultrabert-380M-bias-type-classifier",
    top_k=None,
    trust_remote_code=True
)

text = "Tall people are so clumsy."
predictions = classifier(text)

# Print predictions
for pred in sorted(predictions[0], key=lambda x: x['score'], reverse=True)[:5]:
    print(f"{pred['label']}: {pred['score']:.3f}")

# Output:
# physical: 1.000
# gender: 0.002
# age: 0.000
# socioeconomic: 0.000
# disability: 0.000

---

How the Model Was Created

The model was fine-tuned for bias detection using the following hyperparameters:

• Learning Rate: 2e-5
• Batch Size: 16
• Weight Decay: 0.01
• Warmup Steps: 0
• Optimizer: AdamW
• Evaluation Metrics: Precision, Recall, F1 Score (weighted), Accuracy

---

Dataset

The synthetic dataset consists of biased statements and questions generated by Mistral 7B as part of the GUS-Net paper. It covers 11 bias categories:

1. Racial
2. Religious
3. Gender
4. Age
5. Nationality
6. Sexuality
7. Socioeconomic
8. Educational
9. Disability
10. Political
11. Physical

---

Evaluation Results

The model was evaluated on the synthetic dataset’s test split. The overall metrics using a threshold of 0.5 are as follows:

Macro Averages:

Per-Label Results:

---

Intended Use

The model is designed to detect and classify bias in text across 11 categories. It can be used in applications such as:

• Content moderation
• Bias analysis in research
• Ethical AI development

---

Limitations and Biases

• Synthetic Nature: The dataset consists of synthetic text, which may not fully represent real-world biases.
• Category Overlap: Certain biases may overlap, leading to challenges in precise classification.
• Domain-Specific Generalization: The model may not generalize well to domains outside the synthetic dataset’s scope.

---

Environmental Impact

• Hardware Used: NVIDIA DGX Spark (GB10)
• Training Time: ~2 hours
• Carbon Emissions: ~0.12 kg CO2 (calculated via ML CO2 Impact Calculator).

---

Citation

If you use this model, please cite it as follows:

@misc{junque2025emotion,
  title        = {Emotion and Bias Classification with Modern Encoders},
  author       = {Junqu\'e de Fortuny, Enric},
  year         = {2025},
  howpublished = {\url{https://huggingface.co/spaces/cirimus/emotion-detection}}
}