🦉 CodeSearch-ModernBERT-Owl-Plus: High-Performance Sentence-BERT for Code Search

CodeSearch-ModernBERT-Owl-Plus is a high-performance code search model fine-tuned in a Sentence-BERT architecture, based on the pretrained CodeModernBERT-Owl v1.0.

This model is optimized for function-level search within codebases and natural language queries, achieving state-of-the-art results on the MTEB benchmark.

---

🛠 Features

• ✅ Fine-tuned in Sentence-BERT format from CodeModernBERT-Owl
• ✅ Supports multiple languages (Python, Java, JavaScript, etc.)
• ✅ Specialized encoder for high-accuracy code search
• ✅ Ideal for multi-stage (dual encoder) retrieval setups
• ✅ Generates rich semantic embeddings for code and queries

---

📊 Evaluation on MTEB Benchmark

🏆 Main Scores in MTEB

This model achieved the following main scores (based on NDCG@10):

• CodeSearchNetRetrieval: main_score = 0.8918
• COIR-CodeSearchNetRetrieval: main_score = 0.8013

---

🧪 CodeSearchNetRetrieval (MTEB)

This model achieves strong performance across all ranking metrics and demonstrates balanced retrieval capability.

---

🧪 COIR-CodeSearchNetRetrieval (MTEB)

Robust and consistent performance is also maintained on the COIR dataset, demonstrating strong generalization.

---

📥 Usage Example

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("Shuu12121/CodeSearch-ModernBERT-Owl-Plus")
embeddings = model.encode(["binary search function", "def binary_search(arr, target): ..."])

---

📝 Conclusion

• ✅ An optimized Sentence-BERT model based on CodeModernBERT-Owl
• ✅ Achieves MRR@10 > 0.87 on MTEB CodeSearchNetRetrieval
• ✅ Ready for integration in production-level code search systems

---

📜 License

📄 Apache-2.0

📧 Contact

For questions or inquiries, feel free to reach out: 📧 shun0212114@outlook.jp