antoinelouis/french-mgte-base

🤗 Hugging Face 来源sentence-similarityapache-2.0142M 参数568 MBsafetensors✓ 1 个校验和今天更新
需要做种者 →

pipeline_tag: sentence-similarity language: fr license: apache-2.0 tags:

  • passage-retrieval
  • sentence-similarity
  • pruned library_name: sentence-transformers base_model: Alibaba-NLP/gte-multilingual-base base_model_relation: quantized

🇫🇷 french-mgte-base

This model is a 53.5% smaller version of Alibaba-NLP/gte-multilingual-base for the French language, created using the mtem-pruner space.

This pruned model should perform similarly to the original model for French language tasks with a much smaller memory footprint. However, it may not perform well for other languages present in the original multilingual model as tokens not commonly used in French were removed from the original multilingual model's vocabulary.

Usage

You can use this model with the Transformers library:

from transformers import AutoModel, AutoTokenizer

model_name = "antoinelouis/french-gte-multilingual-base"
model = AutoModel.from_pretrained(model_name, trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True, use_fast=True)

Or with the sentence-transformers library:

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("antoinelouis/french-gte-multilingual-base")

Credits: cc @antoinelouis