W4A16 gs32 GPTQ quant of cyberagent/Mistral-Nemo-Japanese-Instruct-2408 w/ GPTQModel 1.7.2 using augmxnt/ultra-orca-boros-en-ja-v1 as calibration set
W4A16 gs32 GPTQ quant of cyberagent/Mistral-Nemo-Japanese-Instruct-2408 w/ GPTQModel 1.7.2 using augmxnt/ultra-orca-boros-en-ja-v1 as calibration set