This model is a quantized version of WeiboAI/VibeThinker-1.5B and is converted to the OpenVINO format. This model was obtained via the nncf-quantization space with optimum-intel.
First make sure you have optimum-intel installed:
pip install optimum[openvino]
To load your model you can do as follows:
from optimum.intel import OVModelForCausalLM
model_id = "asaqibs/VibeThinker-1.5B-openvino-8bit"
model = OVModelForCausalLM.from_pretrained(model_id)
Have the files? Submit a torrent.
Submit a torrent →Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo asaqibs/VibeThinker-1.5B-openvino-8bit ./model-folder