all-MiniLM-L6-v2-wealth

sentence-transformers/all-MiniLM-L6-v2 fine-tuned for searching wealth-management client files: an adviser types a short query ("evidence of residence", "where does the client's money come from", "pension") and should get the matching documents (utility bills, bank statements, payslips, pension statements, ...).

General-purpose embedding models lack this domain knowledge: for "address proof" they rank a passport above a utility bill. This model was trained to close that gap while keeping general finance retrieval intact. Same size and output as the base model (6 layers, 384-dim, ~23M parameters), so it is a drop-in replacement and runs fast on CPU.

Built for the search API in nevis-search-api.

Usage

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("UmbrellaMalware/all-MiniLM-L6-v2-wealth")
docs = ["British Gas bill\nElectricity and gas charges for 14 Elm Grove, Manchester ...",
        "Passport scan\nBiographical page of a British passport ..."]
query = model.encode("evidence of residence", normalize_embeddings=True)
scores = model.encode(docs, normalize_embeddings=True) @ query

Encode documents as "<title>\n<content>". Use cosine similarity (normalised embeddings).

Training

• Data: fully synthetic, no real client data. gpt-4.1-mini generated 264 documents across 44 categories (KYC/onboarding, income and source of funds, tax, investments, pensions, estate planning, insurance, plus non-advice distractors) and 6 adviser-style queries per document: 1,584 (query, document) pairs. Documents read like the real thing and do not state their purpose; queries mix document types, the compliance/advice purpose, questions and keywords.
• Decontamination: the generator never saw the evaluation documents or queries; generated queries equal or close (cosine >= 0.9) to any evaluation query would have been dropped (none were).
• Objective: MultipleNegativesRankingLoss (in-batch negatives), NO_DUPLICATES batches.
• Hyper-parameters: 3 epochs, batch size 64, learning rate 2e-5, 10% warm-up, fp16. ~8 seconds on an RTX 4050 Laptop GPU.

Evaluation

Hand-labelled benchmark from nevis-search-api (scripts/benchmark_search.py): 42 documents, 38 labelled queries in three groups, 5 noise queries. "Glossary" queries use KYC terms, "held-out" queries paraphrase the same concepts in other words, "other" queries cover general finance concepts. R@5 = share of relevant documents in the top 5.

Three training runs with different seeds gave held-out R@5 0.58-0.60, so the gain is stable.

Combined with a small domain glossary for query expansion (as nevis-search-api does), it reaches 0.85 / 1.00 on glossary queries and F1 0.64.

Limitations

• Training documents are LLM-generated and cover the same categories as the benchmark, so the benchmark numbers are likely optimistic; real documents are messier and more varied.
• The benchmark is small and hand-labelled by the same author. Validate on real, anonymised adviser queries before relying on it.
• English only; UK/EU-flavoured terminology (council tax, ISA, SIPP, probate).
• Inherits the base model's 256-token input limit: chunk long documents.