v0-ettin68m-token_level-0-3 (legacy: LoRA fine-tune of knowledgator/gliner-pii-small-v1.0, Ettin-68M)

Superseded. For current pt-BR PII detection use arthrod/gliner-mmbert-small-ptbr-pii-full-3x-v1, the Ettin models of the current suite (gliner-ettin-68m-ptbr-pii-full-3x-v1), or arthrod/gliner-opf-ptbr-pii-v1.

TL;DR. A token-level GLiNER for Brazilian-Portuguese PII ("LGPD"), from February 2026. It continues knowledgator/gliner-pii-small-v1.0, whose encoder is jhu-clsp/ettin-encoder-68m (ModernBERT, 19 layers, hidden 512). Training used a rank-256 LoRA on the encoder's attention/MLP projections. The run was planned for 5 epochs (19,515 steps). Early stopping ended it at step 7,200 (epoch 1.84) after 5 evals without improvement. The best eval loss was at step 6,200 (104.92). load_best_model_at_end: true was set, so final_model/ should be that checkpoint with LoRA merged, but the repo does not record this. The training config's hub target was arthrod/gliner-lgpd-br-tokenlevel-lora-small-v1 (W&B run gliner-lgpd-br-tokenlevel-lora-small-v1).

v0, token_level and ettin68m in the repo name are accurate. 0-3 is not explained anywhere in the repo.

Related repos

Quick start

final_model/ is a self-contained GLiNER folder (merged weights, 326 MB). GLiNER 0.2.25 has no subfolder argument, so download it and pass the local path:

from huggingface_hub import snapshot_download
from gliner import GLiNER

path = snapshot_download("arthrod/v0-ettin68m-token_level-0-3", allow_patterns=["final_model/*"])
model = GLiNER.from_pretrained(f"{path}/final_model")

text = "Meu nome é Maria Silva, CPF 123.456.789-09, telefone (11) 98765-4321."
labels = ["first name", "last name", "cpf document number", "phone number"]
for ent in model.predict_entities(text, labels, threshold=0.5):
    print(ent["text"], "->", ent["label"], round(ent["score"], 3))

This snippet was not run against these weights for this card. Configs were written by transformers 5.1.0.

Files and checkpoint layout

Checkpoints

Eval loss is from models/checkpoint-7200/trainer_state.json (best_global_step: 6200, best_metric: 104.92). Eval used 2,000 held-out examples (max_eval_samples: 2000). "Mean train loss" is over the 200 steps before each eval (logged every 10 steps). Focal loss with sum reduction. Rows marked "–" in the Saved column were evaluated but their checkpoint is no longer in the repo.

Best checkpoint: models/checkpoint-6200 (lowest eval loss, recorded by the Trainer as best_model_checkpoint).

Training data

Local files data/train.json / data/val.json, not published and not linked from the repo. From the trainer state: 3,903 steps per epoch at batch 96, so about 375k training examples (derived). Eval used 2,000 examples. The run and hub names (gliner-lgpd-br-…) say it targets PT-BR personal data under Brazil's LGPD. The label set is not recorded in this repo.

Training recipe

From config_resolved.json:

• Init knowledgator/gliner-pii-small-v1.0 (encoder jhu-clsp/ettin-encoder-68m), span_mode: token_level, max_len 2048, max_types 100, max_neg_type_ratio 1, max_width 12, hidden_size 768, dropout 0.3, subtoken_pooling: first.
• LoRA on the encoder: r 256, alpha 512, dropout 0.05, targets Wqkv, Wo, Wi, no bias.
• 5 epochs planned, cosine schedule, 732 warmup steps; batch 96 (eval 64); LR encoder 1e-4, LR others 5e-5; weight decay 0.01 / 0.1; grad clip 10.0; bf16.
• Focal loss alpha 0.75, gamma 2, sum reduction; negatives 1.0; shuffle_types and random_drop on.
• Eval and save every 200 steps; load_best_model_at_end on eval loss; early stopping with patience 5 (triggered at step 7,200). The trainer state stores the checkpoint path /mnt/workspace/gliner_logs/models/checkpoint-6200.
• Pushed with upload-large-folder on 2026-02-16.

The saved gliner_config.json files contain fields inherited from the parent model's config that do not describe this run (e.g. name: "span level gliner", train_data: data/pii_full.json, lr_encoder: "1e-5", num_steps: 30000). Trust config_resolved.json for the recipe.

Evaluation

Recorded in this repo

Eval loss only (table above).

Previously reported (not reproducible from this repo)

An April-2026 version of this card reported the numbers below, "evaluated via the scripts in gliner-onnx-benchmark" (arthrod/gliner_central, a GitHub repo that is no longer public). Neither the prediction files nor the script are in this repo, so they cannot be re-checked. That card itself warned that the holdouts "diverge by > 0.3 F1 … likely a label-space mismatch between evaluation sets".

The mistral_ws row matches the "ettin-68m" row for urchade/synthetic-pii-ner-mistral-v1 in the older cross-model table of this card (Strict F1 0.0269, Partial F1 0.1705). That table also lists ettin-68m on nvidia/Nemotron-PII at Strict F1 0.1493 / Partial F1 0.3210, with the note that fine-tuned models "overfit heavily — great on holdout, collapse on external data". The same table's holdout row is labelled "ettin-68m ckpt-22k". This repo has no step 22,000, so that row is probably a different run.

training_log_history.parquet

757 rows (721 train + 36 eval). Examples:

[
  {"kind": "train", "step": 7200, "epoch": 1.845, "loss": 255.8208, "grad_norm": 937.70, "learning_rate": 3.977e-05, "eval_loss": null, "eval_runtime": null, "eval_samples_per_second": null},
  {"kind": "eval", "step": 6200, "epoch": 1.589, "loss": null, "grad_norm": null, "learning_rate": null, "eval_loss": 104.921, "eval_runtime": 5.570, "eval_samples_per_second": 359.051}
]

Limitations

• No task metric can be reproduced from this repo, and the externally reported ones disagree wildly across holdouts.
• Training data and label set are unpublished.
• Whether final_model/ equals checkpoint-6200 (merged) is inferred from load_best_model_at_end, not verified.
• English-pretrained encoder (Ettin) fine-tuned on PT-BR. Expect weaker results on out-of-domain text.

License

Apache-2.0 as declared, matching the parent knowledgator/gliner-pii-small-v1.0 (Apache-2.0). The encoder jhu-clsp/ettin-encoder-68m is MIT.

Citation

@misc{arthrod_v0_ettin68m_token_level,
  author = {arthrod},
  title  = {v0-ettin68m-token_level-0-3: LoRA fine-tune of knowledgator/gliner-pii-small-v1.0 for PT-BR PII},
  year   = {2026},
  url    = {https://huggingface.co/arthrod/v0-ettin68m-token_level-0-3}
}