Comment on Smaller, faster, safer: running Kimi and GLM at scaleparentComments−scrlk1moKL divergence is your friend when it comes to evaluating the effects of quantisation: https://en.wikipedia.org/wiki/Kullback%E2%80%93Leibler_diver...
Comments
KL divergence is your friend when it comes to evaluating the effects of quantisation: https://en.wikipedia.org/wiki/Kullback%E2%80%93Leibler_diver...