I just used mergekit to convert to f16 this model CalderaAI/Hexoteric-7B.
The following YAML configuration was used to produce this model:
base_model:
model:
path: CalderaAI/Hexoteric-7B
dtype: float16
merge_method: task_arithmetic
slices:
- sources:
- layer_range: [0, 32]
model:
model:
path: CalderaAI/Hexoteric-7B
parameters:
weight: 1.0
model-00003-of-00004.safetensors 4.0 GBmodel-00001-of-00004.safetensors 4.0 GBmodel-00002-of-00004.safetensors 4.0 GBmodel-00004-of-00004.safetensors 2.6 GBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Aryanne/CalderaAI_Hexoteric-7B-F16 ./model-folder