docling-gguf
- run it with
gguf-connector; simply execute the command below in console/terminal
ggc n3
GGUF file(s) available. Select which one to use:
- docling-iq4_nl.gguf
- docling-q6_k.gguf
- docling-q8_0.gguf
Enter your choice (1 to 3): _
- opt a
gguffile in your current directory to interact with; nothing else
docling is a multimodal image-text-to-text model engineered for efficient document conversion; for more details, please refer to the base model from ibm🐥 btw, you are able to customize the output token (more tokens longer wait) with ggc n3
reference
- gguf-connector (pypi)