Comment on Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapsesComments−mrrrcs14dOne run per cell is more noise than the gap you are measuring−staredOP14dThese was some code budget there.But as from seeing various runs, errors bars are gross overestimation (as not "the same test", but "if we have different tasks from the same sample").
Comments
One run per cell is more noise than the gap you are measuring
These was some code budget there.
But as from seeing various runs, errors bars are gross overestimation (as not "the same test", but "if we have different tasks from the same sample").