A ModernBERT model (answerdotai/ModernBERT-base) fine-tuned on NLI and tabular classification datasets using sentence-transformers.
You need transformers>=4.48.0 to use ModernBERT (or install from source using pip install git+https://github.com/huggingface/transformers.git). You might also want to install flash attention: pip install flash-attn.
Usage:
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("clembi/ModernBERT-base-embed")
sentences = [
"bi-directional embedding methods are cool",
"I like playing Mario Kart",
"They all got into the Mupalupux and drove south.",
]
embeddings = model.encode(sentences)