Rackspace Cloud Hosting
Using Rackspace Cloud Servers for your web hosting is the perfect solution for the budget-conscious startup with good growth capabilities - but as long as you know how to run a server. Windows server images are available, but the guides and information here relate to the various Linux distributions that are on offer.
If you want a standard LAMP stack and ave a basic grasp of SSH and command-line operations, then read on...