Comment on Machine Learning Cheat Sheet for scikit-learnparentComments−tlarkworthy13y" find the number of clusters"Plot k against prediction accuracy (averaged over a number of runs). Look for a step, that is the correct setting of k. I don't believe there exists an algorithm for detecting that step as good as I can.−ogrisel13yPrediction accuracy cannot be computed in a purely unsupervised setting: you don't have labels for the samples.You can compare the cluster found by k-means run several times against what you get with a randomized version of your dataset though: http://blog.echen.me/2011/03/19/counting-clusters/−dk899613yI think its called x-means algo. Here is the paper http://www.cs.cmu.edu/~dpelleg/download/xmeans.pdf
Comments
" find the number of clusters"
Plot k against prediction accuracy (averaged over a number of runs). Look for a step, that is the correct setting of k. I don't believe there exists an algorithm for detecting that step as good as I can.
Prediction accuracy cannot be computed in a purely unsupervised setting: you don't have labels for the samples.
You can compare the cluster found by k-means run several times against what you get with a randomized version of your dataset though: http://blog.echen.me/2011/03/19/counting-clusters/
I think its called x-means algo. Here is the paper http://www.cs.cmu.edu/~dpelleg/download/xmeans.pdf