granite-4.2-3b-gguf
granite-4.2-3b-gguf is a GGUF 4_K_M (int4) quantized version of ibm-granite/granite-4.2-3b, providing a very fast, very small inference implementation, optimized for AI PCs.
Model Description
- Developed by: ibm-granite
- Model type: granite
- Parameters: 3 billion
- Model Parent: ibm-granite/granite-4.2-3b
- Language(s) (NLP): English
- License: Apache 2.0
- Uses: Chat, general-purpose LLM
- Quantization: 4_K_M (int4)