I get the feeling that the people who don't like algorithms interviews are also the people who find them difficult to pass.

Go ahead and memorize, it'll be obvious if you can't explain how you got that answer.