Qwen3-Embedding-0.6B finetuned on PLOTS
Qwen/Qwen3-Embedding-0.6B finetuned on PLOTS, pairs of independently written Wikipedia plot summaries of the same film (English plot paired with its plot in another language), to match stories rather than words or names.
Training
197,694 training pairs; symmetric in-batch contrastive loss (InfoNCE in both directions) with gradient caching, batch 128, 1 epoch, learning rate 1e-05, maximum input length 512 tokens, seed 13. Films of SemEval-2026 Task 4 and TREC ToT 2023 (train and dev targets) are excluded from training.
Results
NS: accuracy on the 355 leak-free SemEval-2026 Task 4 track-B test triples. PLOTS-IR: nDCG@10 on the test queries (M: entity-masked). ToT: TREC ToT 2023 dev queries.
| NS acc. | Full | Full M | First | Last | Last M | ToT nDCG@10 | ToT R@100 | |
|---|---|---|---|---|---|---|---|---|
| this model | 0.651 | 0.988 | 0.819 | 0.810 | 0.384 | 0.074 | 0.138 | 0.427 |
| Qwen3-Embedding-0.6B, zero-shot | 0.566 | 0.959 | 0.656 | 0.755 | 0.384 | 0.069 | 0.106 | 0.313 |
Usage
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("Jgmorenof/plots-qwen3-embedding-0.6b", trust_remote_code=True)
queries = ["<plot summary or description of a film, in any language>"]
documents = ["<English plot summary>"]
q = model.encode(queries, prompt="Instruct: Given a story summary, retrieve the plot summary of the same film\nQuery:")
D = model.encode(documents, prompt="")
scores = model.similarity(q, D)
- For tip-of-the-tongue requests we used the query prompt "Instruct: Given a description of a movie someone half-remembers, retrieve the movie's Wikipedia page\nQuery:"; for symmetric story-to-story similarity (SemEval) "Instruct: Retrieve semantically similar text\nQuery:" on both sides.
License
The weights keep the license of the base model (apache-2.0). The training data (PLOTS) is CC BY-SA 4.0.
Citation
@misc{moreno2026plots,
title = {{PLOTS} -- Same Story, Different Words: Paired Plot Outlines for Narrative Similarity and Retrieval},
author = {Moreno, Jose G. and Hamdi, Ahmed and Boros, Emanuela and Jatowt, Adam and Bordea, Georgeta and Gonz{\'a}lez-Gallardo, Carlos-Emiliano and Doucet, Antoine},
year = {2026},
howpublished = {\url{https://huggingface.co/datasets/Jgmorenof/PLOTS}}
}