Saved file metadata (16 files)
Historical source metadata, not copies of the files. A checksum does not establish current availability.
openvino_model.bin
613946d5c29095bd91d74ead07d15b83247b9e6ad7d576c1f1875e154e880b79
openvino_model.xml
SHA-256 not recorded
tokenizer.json
SHA-256 not recorded
openvino_tokenizer.bin
22c222c383dac6ccc43b495af24d81193b461af6f9c9d3c256aef2b0f2a26175
openvino_detokenizer.bin
8a8b1249fca76cc50137fe1d8957952033bed6d18ceedfe497ea46e1b5f69efc
openvino_tokenizer.xml
SHA-256 not recorded
model.safetensors.index.json
SHA-256 not recorded
openvino_detokenizer.xml
SHA-256 not recorded
tokenizer_config.json
SHA-256 not recorded
config.json
SHA-256 not recorded
.gitattributes
SHA-256 not recorded
README.md
SHA-256 not recorded
special_tokens_map.json
SHA-256 not recorded
openvino_config.json
SHA-256 not recorded
added_tokens.json
SHA-256 not recorded
generation_config.json
SHA-256 not recorded
Saved model card (historical)
This model is a quantized version of microsoft/Phi-3.5-mini-instruct and is converted to the OpenVINO format. This model was obtained via the nncf-quantization space with optimum-intel.
First make sure you have optimum-intel installed:
pip install optimum[openvino]
To load your model you can do as follows:
from optimum.intel import OVModelForCausalLM
model_id = "AlexKoff88/Phi-3.5-mini-instruct-openvino-8bit"
model = OVModelForCausalLM.from_pretrained(model_id)
Model discussions
Share what you know. Help others. Build trust.
Loading comments...
Keep it about the model. No spam, scams or personal attacks. Links are not allowed in comments or replies. Comment policy