AlexWortega/smallstral

🤗 Hugging Face sourcetext-generationapache-2.02.4B params9.8 GBsafetensors✓ 2 checksumsupdated today

Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo AlexWortega/smallstral ./model-folder

Needs a seeder →

Smallstral, layer pruned Mistral

Task	Metric	Mistral-7B-v0.1 Value	Smallstral Value
hendrycksTestRu-high_school_mathematics	acc	0.3037	0.2852
hendrycksTestRu-high_school_microeconomics	acc	0.3950	0.3319
hendrycksTestRu-high_school_physics	acc	0.3113	0.2649
hendrycksTestRu-high_school_psychology	acc	0.5193	0.1945
hendrycksTestRu-high_school_statistics	acc	0.3241	0.4028
hendrycksTestRu-high_school_us_history	acc	0.5392	0.2451
hendrycksTestRu-high_school_world_history	acc	0.5781	0.2321
hendrycksTestRu-human_aging	acc	0.4843	0.3184
parus	acc	0.5000	0.4875
rcb	acc	0.3653	0.3288
rcb	f1_macro	0.3313	0.1691
rwsd	acc	0.4917	0.4901