Flan-T5 Small — ONNX
ONNX export of Flan-T5 Small (77M parameters) with encoder-decoder architecture and KV cache support.
Converted for use with inference4j, an inference-only AI library for Java.
Original Source
- Repository: google/flan-t5-small
- License: Apache 2.0
Usage with inference4j
// Summarization
try (var gen = FlanT5TextGenerator.flanT5Small().build()) {
System.out.println(gen.summarize("Long article text..."));
}
// Translation
try (var gen = FlanT5TextGenerator.flanT5Small().build()) {
System.out.println(gen.translate("Hello!", Language.EN, Language.FR));
}
Model Details
| Property | Value |
|---|---|
| Architecture | T5 encoder-decoder (77M parameters) |
| Tasks | Summarization, translation, grammar correction, text-to-SQL |
| Tokenizer | SentencePiece (32,128 tokens) |
| Original framework | PyTorch (transformers) |
| Export method | Hugging Face Optimum (encoder-decoder with KV cache) |
License
This model is licensed under the Apache License 2.0. Original model by Google.