Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapsesquesma.com 3 pointsstared14 days ago2 commentsSaveHideCopy link On HNComments−mrrrcs14dOne run per cell is more noise than the gap you are measuring−staredOP13dThese was some code budget there.But as from seeing various runs, errors bars are gross overestimation (as not "the same test", but "if we have different tasks from the same sample").
Comments
One run per cell is more noise than the gap you are measuring
These was some code budget there.
But as from seeing various runs, errors bars are gross overestimation (as not "the same test", but "if we have different tasks from the same sample").