🌟 BloomVN-8B-chat 🌟

A fine-tuned multilingual model for Vietnamese language

📋 Overview

• A bilingual text generation model with strong capabilities in both Vietnamese and English languages.
• This base model can handle a wide range of text generation tasks while maintaining high quality output in both languages, making it particularly valuable for Vietnamese-English content creation and language processing applications.

🔧 Method

The training process consists of three main steps:

• Continuous Pre-training (CPT) from Sailor2-8B-Chat using unsloth
• Fine-tuning with Vietnamese instruction dataset
• Applied refusal direction tuning based on "Refusal in LLMs is Mediated by a Single Direction"

📊 VLMU Benchmark

💫 Quantization

• Coming Soon!

🤝 Contributors

Developed with ❤️ by BlossomAI

---

_{Star ⭐️ this repo if you find it valuable!}