Loading…
Loading…
Specialized model for Disease Entity Recognition - Disease entities from the NCBI dataset
High-precision disease NER tuned for research literature, capturing disease mentions suitable for normalization to MeSH/OMIM.Useful for clinical NLP, cohort discovery, and knowledge graph construction, and pairs well with concept-normalization modules.
OpenMed ZeroShot NER is an advanced, domain-adapted Named Entity Recognition (NER) model designed specifically for medical, biomedical, and clinical text mining. Leveraging state-of-the-art zero-shot learning, this model empowers researchers, clinicians, and data scientists to extract expert-level biomedical entities—such as diseases, chemicals, genes, species, and clinical findings—directly from unstructured text, without the need for task-specific retraining.
Built on the robust GLiNER architecture and fine-tuned on curated biomedical corpora, OpenMed ZeroShot NER delivers high-precision entity recognition for critical healthcare and life sciences applications. Its zero-shot capability means you can flexibly define and extract any entity type relevant to your workflow, from standard biomedical categories to custom clinical concepts, supporting rapid adaptation to new research domains and regulatory requirements.
Whether you are working on clinical NLP, biomedical research, electronic health record (EHR) de-identification, or large-scale literature mining, OpenMed ZeroShot NER provides a production-ready, open-source solution that combines expert-level accuracy with unmatched flexibility. Join the OpenMed community to accelerate your medical text analytics with cutting-edge, zero-shot NER technology.
This zero-shot model can identify and classify biomedical entities, including but not limited to these entity types. You can also add custom entity types without retraining the model:
DISEASE💡 Zero-Shot Flexibility: As a GliNER-based model, you can specify any entity types you want to detect, even if they weren't part of the original training. Simply provide the entity labels when using the model, and it will adapt to recognize them.
NCBI Disease corpus is a comprehensive resource for disease name recognition and concept normalization.
The NCBI Disease corpus is a gold-standard dataset containing 793 PubMed abstracts with 6,892 disease mentions mapped to 790 unique disease concepts from Medical Subject Headings (MeSH) and Online Mendelian Inheritance in Man (OMIM). Developed by the National Center for Biotechnology Information, this corpus provides both mention-level and concept-level annotations for disease entity recognition and normalization. The dataset is extensively used for developing clinical NLP systems, medical diagnosis support tools, and biomedical text mining applications. It serves as a critical benchmark for evaluating disease name recognition systems in healthcare informatics and medical literature analysis.
0.7123.4%| Rank | Model | Base F1 | Finetuned F1 | ΔF1 | ΔF1 % |
|---|---|---|---|---|---|
| 🥇 1 | OpenMed-ZeroShot-NER-Pathology-Large-459M | 0.6183 | 0.8983 | 0.2800 | 45.3% |
| 🥈 2 | OpenMed-ZeroShot-NER-Pathology-Medium-209M | 0.6039 | 0.8940 | 0.2901 | 48.0% |
| 🥉 3 | OpenMed-ZeroShot-NER-Pathology-XLarge-770M | 0.6806 | 0.8872 | 0.2066 | 30.4% |
| 4 | OpenMed-ZeroShot-NER-Pathology-Base-220M | 0.6393 | 0.8556 | 0.2163 | 33.8% |
| 5 | OpenMed-ZeroShot-NER-Pathology-Multi-209M | 0.5601 | 0.7726 | 0.2125 | 37.9% |
Rankings are sorted by finetuned F1 and show ΔF1% over base model. Test dataset is excluded from training.
Figure: OpenMed ZeroShot Clinical & Biomedical NER vs. Original GLiNER models.
pip install -q "gliner[tokenizers]"
from transformers import pipeline
# Load the model and tokenizer
# Model: https://huggingface.co/OpenMed/OpenMed-ZeroShot-NER-Pathology-Small-166M
model_name = "OpenMed/OpenMed-ZeroShot-NER-Pathology-Small-166M"
from gliner import GLiNER
model = GLiNER.from_pretrained(model_name)
# Example usage with default entity types
text = "Early detection of breast cancer improves survival rates."
labels = ['DISEASE']
entities = model.predict_entities(text, labels, flat_ner=True, threshold=0.5)
for entity in entities:
print(entity)
💡 Tip: If you want to extract entities that are not present in the original training set (i.e., use custom or rare entity types), you may get better results by lowering the threshold parameter in model.predict_entities. For example, try threshold=0.3 or even lower, depending on your use case:
# You can specify custom entity types for zero-shot recognition - for instance:
custom_entities = ["MISC", "DISEASE", "PERSON", "LOCATION", "MEDICATION", "PROCEDURE"]
entities = model.predict_entities(text, custom_entities, flat_ner=True, threshold=0.1)
for entity in entities:
print(entity)
Lowering the threshold makes the model more permissive and can help it recognize new or less common entity types, but may also increase false positives. Adjust as needed for your application.
This model is particularly useful for:
Licensed under the Apache License 2.0. See LICENSE for details.
I welcome contributions of all kinds! Whether you have ideas, feature requests, or want to join my mission to advance open-source Healthcare AI, I'd love to hear from you.
Follow OpenMed Org on Hugging Face 🤗 and click "Watch" to stay updated on my latest releases and developments.
If you use this model in your research or applications, please cite the following paper:
@misc{panahi2025openmedneropensourcedomainadapted,
title={OpenMed NER: Open-Source, Domain-Adapted State-of-the-Art Transformers for Biomedical NER Across 12 Public Datasets},
author={Maziyar Panahi},
year={2025},
eprint={2508.01630},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2508.01630},
}
Proper citation helps support and acknowledge my work. Thank you!