TEI-Compatible Version of Alibaba-NLP/gte-multilingual-reranker-base

This repository provides a TEI-compatible version of Alibaba-NLP/gte-multilingual-reranker-base.

Key Features

• No need to download additional model architecture files.
• Fully compatible with TEI (Thanks to this pr).

Running with TEI

You can deploy this model with TEI using the following command:

text-embeddings-router --model-id aqweteddy/alibaba-gte-multilingual-reranker-base \
  --dtype float16 \
  --max-client-batch-size 128 \
  --auto-truncate