arXiv abstract classifier — EmbeddingGemma 300M
A PyTorch multilabel classifier for five broad arXiv areas: biology, chemistry,
computer science, physics, and social sciences. It was full-fine-tuned from
google/embeddinggemma-300m on normalized arXiv
abstracts. Inputs are abstracts only; labels are ordered as biology,
chemistry, computer_science, physics, and social_sciences.
Evaluation
Results are from the untouched 20,000-record final holdout split. Per-label thresholds were selected on a separate 20,000-record validation split.
| Macro F1 | Micro F1 | Chemistry F1 | ECE (15 bins) |
|---|---|---|---|
| 0.7998 | 0.9506 | 0.5598 | 0.0073 |
Use is subject to the Gemma terms.
The repository contains the tokenizer, backbone (model.safetensors), PyTorch
classification head (classifier.pt), thresholds and data/model configuration.
Load it with this project's classifier.modeling implementation; the head is
not an AutoModel classification head. Use the preprocessing version recorded in
configuration.json, including its <FORMULA> placeholder handling.
The benchmark protocol and full predictions/metrics are archived with the project release. Bootstrap uncertainty is over held-out examples, not random training seeds.