Yes, that may be best. Personally, when I use software where I have to rate myself, I find myself either "cheating" or at least having to think about how to rate it instead of just focusing on learning. But on the other hand, with just algorithmic evaluation you do get annoyed at times when the algorithm is wrong, so a manual override would be useful.