hfl/chinese-mixtral

🤗 Hugging Face sourcetext-generationapache-2.046.7B params93 GBsafetensors✓ 20 checksumsupdated today

Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo hfl/chinese-mixtral ./model-folder

Needs a seeder →

Chinese-Mixtral

Chinese Mixtral GitHub repository: https://github.com/ymcui/Chinese-Mixtral

This repository contains Chinese-Mixtral, which is further pre-trained on Mixtral-8x7B-v0.1.

Note: this is a foundation model, which is not suitable for conversation, QA, etc.

Others

For LoRA-only model, please see: https://huggingface.co/hfl/chinese-mixtral-lora
For GGUF model (llama.cpp compatible), please see: https://huggingface.co/hfl/chinese-mixtral-gguf
If you have questions/issues regarding this model, please submit an issue through https://github.com/ymcui/Chinese-Mixtral/.

Citation

Please consider cite our paper if you use the resource of this repository. Paper link: https://arxiv.org/abs/2403.01851

@article{chinese-mixtral,
      title={Rethinking LLM Language Adaptation: A Case Study on Chinese Mixtral}, 
      author={Cui, Yiming and Yao, Xin},
      journal={arXiv preprint arXiv:2403.01851},
      url={https://arxiv.org/abs/2403.01851},
      year={2024}
}