ONNX version of Felladrin/TinyMistral-248M-Chat-v4 to use with Transformers.js.
onnx/model.onnx 992 MBonnx/model_fp16.onnx 496 MBonnx/model_q4.onnx 266 MBonnx/model_bnb4.onnx 253 MBonnx/model_uint8.onnx 249 MBonnx/model_int8.onnx 249 MBonnx/model_quantized.onnx 249 MBonnx/model_q4f16.onnx 187 MB