I always look for a few things: Reliability, Support/Knowledge, Price - you get what you pay for really.
I moved to
cloudarion.com server hosting in Switzerland after reading reviews and having a terrible experience with my previous host. Other web hosts could learn a bit from them on pricing, technology and excellent customer service.