gliner-ettin-68m-ptbr-pii-full-3x-v1-checkpoints
Every earlier GLiNER run on jhu-clsp/ettin-encoder-68m for Brazilian-Portuguese PII detection that led to the published model arthrod/gliner-ettin-68m-ptbr-pii-full-3x-v1 (DOI 10.57967/hf/8520), consolidated on 2026-10-11 from five repos into one folder per run. Use the published model for inference; this repo is for reproducing the data-size ablation (top-50k vs top-100k vs full train set), comparing the earlier token-level runs, and resuming or inspecting training.
Related repos
| Repo | Type | Role |
|---|---|---|
| arthrod/gliner-ettin-68m-ptbr-pii-full-3x-v1 | model | Published model (3x budget, 69,000 steps); has the evaluation |
| arthrod/gliner-ettin-32m-ptbr-pii-full-3x-v1-checkpoints | model | Same consolidation for the 32M encoder |
| arthrod/v0-ettin68m-token_level-0-3 | model | Final model of the LoRA run whose early checkpoints are in c3600-ettin68m-token_level-0-5/ |
| arthrod/gliner-mmbert-small-ptbr-pii-full-3x-v1 | model | Strongest GLiNER of the family |
| arthrod/gliner-opf-ptbr-pii-bench-v1 | dataset | Benchmark of the current suite |
Runs
| folder | run | checkpoint-N/ folders (steps) |
size |
|---|---|---|---|
gliner-ettin-68m-ptbr-pii-top50k-v1/ |
Sweep: top-50k curated train set (repo was public until 2026-10-11) | 20 (585–11,700) | 17.82 GB |
gliner-ettin-68m-ptbr-pii-top100k-v1/ |
Sweep: top-100k curated train set | 20 (780–15,600) | 17.82 GB |
gliner-ettin-68m-ptbr-pii-full-v1/ |
Sweep: full ~984k train set (1x budget, 23,000 steps) | 20 (1,150–23,000) | 17.82 GB |
c3600-ettin68m-token_level-0-5/ |
Early checkpoints (steps 200–3,600) of the LoRA run published as v0-ettin68m-token_level-0-3 |
18 (200–3,600) | 14.59 GB |
c22k-ettin68m-token_level-0-3/ |
"PII Small Mimic" token-level run on a top-50k reward-scored set; best = step 22,000 (strict F1 0.4509 per its README) | 11 (2,000–22,000) | 10.80 GB |
Each run folder holds only checkpoint-N/ subfolders plus the original repo's README (with that run's recipe and
metrics). Every file was copied byte-for-byte; sha256 was verified against the source repo before the source was
deleted. The old names of the four copied repos no longer resolve; gliner-ettin-68m-ptbr-pii-full-v1 was renamed
into this repo and still redirects here.
How to use
The whole repo is about 79 GB; download one checkpoint:
from huggingface_hub import snapshot_download
from gliner import GLiNER
ckpt = "gliner-ettin-68m-ptbr-pii-top50k-v1/checkpoint-11700" # last step of that run
path = snapshot_download("arthrod/gliner-ettin-68m-ptbr-pii-full-3x-v1-checkpoints",
allow_patterns=[f"{ckpt}/*"], ignore_patterns=["*.pt", "*.pth"])
model = GLiNER.from_pretrained(f"{path}/{ckpt}")
model.predict_entities("Meu CPF é 123.456.789-09.", ["cpf document number"], threshold=0.5)
optimizer.pt, scheduler.pt and rng_state.pth are only needed to resume training. The LoRA run in
c3600-ettin68m-token_level-0-5/ may store adapter checkpoints; see that folder's README for how to load them.
Limitations
- Ablation and intermediate runs: they score below the published 3x model (see each folder's README and the published card for metrics).
- Trained on synthetic PT-BR PII; all identities in the training data are generated.
gliner==0.2.25has nosubfolderargument, hence the local-path loading above.