The biggest problem with Microsoft software is imo not the price, but the complicated licensing structure of their software. When reading pages on microsoft.com about licensing you will get a headache if you're not an accountant. With Linux you can simply deploy another server if you need one, without thinking about all those licensing programs and restrictions.

A related question that i have is: would a startup be less attractive for potential buyers like Google and Yahoo if it uses Microsoft technologies?