- Using
opencsg/csg-wukong-2b-chinese-fineweb-eduas base model, we fine-tune it onsmoltalk-chinesefor 2 epoch - learning rate = 3e-4 ; global batch size = 32 ; lr scheduler=cosine
opencsg/csg-wukong-2b-chinese-fineweb-edu as base model, we fine-tune it on smoltalk-chinese for 2 epochHave the files? Submit a torrent.
Submit a torrent →Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo opencsg/csg-wukong-2b-smoltalk-chinese ./model-folder