This is an ONNX version of NovatasticRoScript/Atomight-V2.2-UltraThink-0.5B. It was automatically converted and uploaded using this Hugging Face Space.
See the pipeline documentation for text-generation: https://huggingface.co/docs/transformers.js/api/pipelines#module_pipelines.TextGenerationPipeline
1st teacher model for upcoming Atomight-V2.2, we'll be released soon. Future teacher mdoels: UltraMath, UltraCode, UltraBench, and more..
This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.
onnx/model_bnb4.onnx 855 MBonnx/model_q4.onnx 855 MBonnx/model_uint8.onnx 632 MBonnx/model_int8.onnx 632 MBonnx/model_quantized.onnx 632 MBonnx/model_q4f16.onnx 552 MBonnx/model.onnx 1 MBonnx/model_fp16.onnx 0.1 kB