HERBERT: Leveraging UMLS Hierarchical Knowledge to Enhance Clinical Entity Normalization in Spanish

HERBERT-P is a contrastive-learning-based bi-encoder for medical entity normalization in Spanish, leveraging synonym and parent relationships from UMLS to enhance candidate retrieval for entity linking in clinical texts.

Key features:

• Base model: PlanTL-GOB-ES/roberta-base-biomedical-clinical-es
• Trained with 30 positive pairs per anchor (synonyms + parents)
• Task: Normalization of disease, procedure, and symptom mentions to SNOMED-CT/UMLS codes.
• Domain: Spanish biomedical/clinical texts.
• Corpora: DisTEMIST, MedProcNER, SympTEMIST.

---

Benchmark Results