Granite-4.2-30B (NVFP4)
[!NOTE] This repository contains the NVFP4 version of Granite-4.2-30B.
Please refer to the original model's model card for additional details: https://huggingface.co/ibm-granite/granite-4.2-30b
[!NOTE] This repository contains the NVFP4 version of Granite-4.2-30B.
Please refer to the original model's model card for additional details: https://huggingface.co/ibm-granite/granite-4.2-30b
Have the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo ibm-granite/granite-4.2-30b-nvfp4 ./model-folder
LocalMaxxingvllm serve ibm-granite/granite-4.2-30b-nvfp4 --max-model-len 131072 --gpu-memory-utilization 0.94 --max-num-seqs 128 --enable-prefix-caching --trust-remote-codeView run on LocalMaxxing
vllm serve ibm-granite/granite-4.2-30b-nvfp4 --max-model-len 57344 --gpu-memory-utilization 0.94 --max-num-seqs 128 --enable-prefix-caching --trust-remote-code --kv-cache-dtype int4_per_token_head --attention-backend TRITON_ATTNView run on LocalMaxxing
Median of 8 community runs on 2 setups, from LocalMaxxing.
Run it yourself: setup guide