AlexWortega/smallstral

🤗 Hugging Face 来源text-generationapache-2.02.4B 参数9.8 GBsafetensors✓ 2 个校验和今天更新

一条命令提交

在你的模型文件夹旁边运行它。它会制作种子、将文件与 Hugging Face 比对，然后提交。你只需开始做种，并粘贴你账户中的密钥。它只读取你的文件，绝不修改。如果愿意，可以先阅读脚本。

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo AlexWortega/smallstral ./model-folder

Smallstral, layer pruned Mistral

Task	Metric	Mistral-7B-v0.1 Value	Smallstral Value
hendrycksTestRu-high_school_mathematics	acc	0.3037	0.2852
hendrycksTestRu-high_school_microeconomics	acc	0.3950	0.3319
hendrycksTestRu-high_school_physics	acc	0.3113	0.2649
hendrycksTestRu-high_school_psychology	acc	0.5193	0.1945
hendrycksTestRu-high_school_statistics	acc	0.3241	0.4028
hendrycksTestRu-high_school_us_history	acc	0.5392	0.2451
hendrycksTestRu-high_school_world_history	acc	0.5781	0.2321
hendrycksTestRu-human_aging	acc	0.4843	0.3184
parus	acc	0.5000	0.4875
rcb	acc	0.3653	0.3288
rcb	f1_macro	0.3313	0.1691
rwsd	acc	0.4917	0.4901