I never really use sort by price because I find that the cheapest results are usually not very relevant

That's exactly part of the problem. If I'm searching for something specific like 'iPod Touch 32GB' I should not get results for $0.99 iPod cables and cases.