和： https://huggingface.co/Zhaoming213/BackTo2012 一致。
由于训练周期太长了，仅仅训练了6%，故放弃训练了！
模型的checkpoints保存在了minimind-master/checkpoints里了，有想继续训练的可以下载。
训练架构是：https://github.com/jingyaogong/minimind
| 模型信息 | 数值 |
|---|---|
| 维度 | 768 |
| 隐藏层 | 16 |
| 序列长度 | 512 |
GPU：T4 16GB X2
训练时长: 20小时+
数据集：差不多7GB
minimind-master/checkpoints/pretrain_768_resume.pth 1.1 GBminimind-master/checkpoints/pretrain_768.pth 218 MBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Zhaoming213/backto2012-largemodel-checkpoints ./model-folder