lfq_acc.md

August 25, 2026 ยท View on GitHub

iters 200 enable_alg_ext is turned on Qwen3-8B

lfq causes large drop, maybe some bugs in our implementation

ModelARC-cARC-eBoolQHellaLAMBMMLUOBQAPIQATruth.WinoGSM8Kif-eval stirctmmlu-proAVG.
LFQ W2G640.30460.53960.67830.38560.23400.28220.20000.64360.30110.55640.34190.2206+0.11830.2334
ours W2G640.39420.74120.78410.42820.52420.54980.25400.70510.30970.64640.52390.2542+0.12010.2745
LFQ w3g1280.49490.76050.80610.52760.48830.65580.28600.75300.34520.67170.82410.3777+0.23660.4076
oursw3g1280.52130.80930.86670.53190.64450.69490.31400.75460.36230.70880.85970.3333+0.19040.4269