加载中…
加载中…
OTel-Embedding-34M is a telecom embedding model full-parameter fine-tuned on OTel telecommunications data. It is part of the OTel Family of Models, an open-source initiative to build reference AI resources for the global telecommunications sector.
Across the 10 OTel embedding baselines, OTel fine-tuning improves telecom retrieval quality by +9.2 to +59.7 NDCG@10 percentage points.
As of May 3, 2026, the released OTel models had been downloaded over 16 million times, and the Open Telco AI project had received 157+ pieces of media coverage worldwide.
| Attribute | Value |
|---|---|
| Base model | sentence-transformers/all-MiniLM-L12-v2 |
| Parameters | 34M |
| OTel training dataset | OTel-Embedding |
| Dataset fields | anchor, positive, negative_1 through negative_5 |
| Training method | Full-parameter post-training / fine-tuning |
| Language | English |
| OTel release license | Apache 2.0 |
sentence-transformers/all-MiniLM-L12-v2 -> OTel-Embedding full-parameter post-training -> att/OTel-Embedding-34M
| Metric | Base model | OTel fine-tuned | Delta | Evaluation split |
|---|---|---|---|---|
| NDCG@10 | 29.2% | 84.6% +/- 0.8 | +55.4 pp | OTel-Embedding held-out 10% |
Standard errors are computed with bootstrap resampling (n=1000) over the held-out OTel evaluation partition. NDCG@10 measures whether relevant telecom passages are ranked near the top of the retrieved list.
The model was trained on telecom-focused data curated by 100+ domain experts. The raw corpus contained roughly 1.1M training points and was filtered to 326,767 higher-confidence examples.
| Source | Contributor |
|---|---|
| arXiv telecom papers, 3GPP standards, telecom Wikipedia, telecom Common Crawl | Yale University |
| GSMA Permanent Reference Documents, Discover portal | GSMA |
| IETF RFC series | NetoAI |
| Industry whitepapers | Khalifa University |
| O-RAN specifications (working groups 1, 2, 4, 5, 6, 7, 8, 9, 10) | University of Leeds |
| O-RAN documents across working groups | Purdue University and The University of Texas at Dallas |
Released datasets: OTel-LLM, OTel-Embedding, OTel-Reranker, and OTel-Safety.
The OTel datasets release derived QA/retrieval/reranking examples rather than the raw source documents.
Each released dataset includes a dataset card and Croissant metadata with Responsible AI fields for data limitations, biases, sensitive-information considerations, use cases, social impact, synthetic-data status, and provenance.
OTel-Embedding rows provide one anchor query, one positive passage, and five hard negatives for telecom retrieval training.
{
"anchor": "During the Measurement ID Coordination (MN initiated) test case, what is the relationship between the U-Plane data and the F1 logs as observed in the Protocol Analyzer and the Test UE or UE emulator?",
"positive": "F1 logs recorded in the Protocol Analyzer and the Test UE or UE emulator show that all downlink U-Plane data recorded in the F1 logs is correctly received, and all uplink U-Plane data transmitted by the Test UE or emulated UE is recorded in the F1 logs.",
"negative_count": 5
}
This model is intended to retrieve relevant chunks from telecom specifications, standards, RFCs, whitepapers, and other domain documents. It can be used as the retrieval stage in an end-to-end telecom RAG pipeline, followed by a reranker and a context-grounded LLM.
| Item | Value |
|---|---|
| Framework | ScalarLM |
| Optimizer | AdamW, 8-bit |
| Learning-rate schedule | Cosine decay with warmup |
| Weight decay | 0.01 |
| Warmup steps | 100 |
| Random seed | 42 |
| Maximum sequence length | 1500 tokens |
| Precision | BF16 |
| Attention | Flash Attention 2 |
| Distributed training | Fully Sharded Data Parallel |
| Gradient checkpointing | Enabled |
| Epochs | 3 for LLM/embedding models; 2 for rerankers |
| Compute | AMD MI300X/MI325X/MI355X and NVIDIA A100/H100 GPUs |
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("att/OTel-Embedding-34M")
sentences = [
"What is the F1 interface in O-RAN?",
"The F1 interface connects the O-RAN Distributed Unit (O-DU) to the O-RAN Central Unit (O-CU).",
]
embeddings = model.encode(sentences, normalize_embeddings=True)
print(embeddings.shape)
@inproceedings{tavakkoli2026otel,
title = {OTel: Open Telco AI Datasets, Benchmarks, and Models},
author = {Tavakkoli, Farbod and others},
booktitle = {Advances in Neural Information Processing Systems (NeurIPS), Evaluations and Datasets Track},
year = {2026},
url = {https://github.com/farbodtavakkoli/OTel}
}
If you have any technical questions, please feel free to reach out to farbod.tavakkoli@att.com or farbodtavakoli@gmail.com