- We apply DPO to
opencsg/csg-wukong-2b-smoltalk-chinese, usingultrafeedback-chinese-binarizedas the DPO dataset. - Train 2 epochs, learning rate=5e-6, batchsize=128
opencsg/csg-wukong-2b-smoltalk-chinese, using ultrafeedback-chinese-binarized as the DPO dataset.Have the files? Submit a torrent.
Submit a torrent →Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo opencsg/csg-wukong-2b-ultrafeedback-chinese-binarized ./model-folder