Loki 12B

M6 arch with full gate based on RWKV v6 arch, need more than 24G to load ,and inference code would opensource later.