SmolLM2-1.7B-Instruct — ONNX (FP16)

ONNX export of SmolLM2-1.7B-Instruct (1.7B parameters, FP16 weights) with KV cache support for efficient autoregressive generation.

Converted for use with inference4j, an inference-only AI library for Java.

Original Source

• Repository: HuggingFaceTB/SmolLM2-1.7B-Instruct
• License: Apache 2.0

Usage with inference4j

try (var gen = OnnxTextGenerator.smolLM2_1_7B().build()) {
    GenerationResult result = gen.generate("What is Java?");
    System.out.println(result.text());
}

Model Details

License

This model is licensed under the Apache License 2.0. Original model by HuggingFace.