license: mit language:
- en pipeline_tag: text-generation
My own (ZeroWw) quantizations. output and embed tensors quantized to q8_0. all other tensors quantized to q4_k.
Updated on: Wed Jul 08, 15:01:20
license: mit language:
My own (ZeroWw) quantizations. output and embed tensors quantized to q8_0. all other tensors quantized to q4_k.
Updated on: Wed Jul 08, 15:01:20