I would normally look for in below order:
1) Support
2) Value for Price
3) Uptime. Reliability
Technical support is very important.
You can rely on
http://www.centohost.com/ as they offer cheap hosting packages + affordable domain registration services.
Their uptime is fantastic and ability to upgrade and downgrade is a plus. You can also get 15% off for other services with code "15OFF"