SmolLM3-3B — ONNX (INT4, onnxruntime-genai)

ONNX export of HuggingFaceTB/SmolLM3-3B in onnxruntime-genai format for efficient autoregressive text generation on CPU (INT4 RTN block-32 quantization).

Produced for use with inference4j, an inference-only AI library for Java.

Usage with inference4j

try (var generator = TextGenerator.builder()
        .model(ModelSources.smolLM3_3B())
        .build()) {
    GenerationResult result = generator.generate("Explain quantum computing in simple terms.");
    System.out.println(result.text());
}

Model Details