~3.55BPW custom optimized EXL3 quant of Nex-N2-Pro 397B.
-- A perplexity: 3.27204336
-- B perplexity: 3.28824294
-- A label in top-K:
K = 1: 0.7131
K = 2: 0.8113
K = 3: 0.8530
K = 4: 0.8768
K = 5: 0.8925
-- B label in top-K:
K = 1: 0.7117
K = 2: 0.8106
K = 3: 0.8526
K = 4: 0.8761
K = 5: 0.8922
-- Top-K agreement, A vs B:
K = 1: 0.9551
K = 2: 0.8190
K = 3: 0.6442
K = 4: 0.4761
K = 5: 0.3361
-- KL divergence (A, B): 0.02391939
-- KL divergence (B, A): 0.02346712