It depends how the other contributors are gained. If they choose to help voluntarily, then they have no claim on the development of the project. They can help to mould it as they choose but that is it. If it doesn't go the way they want they have no right to oust the creator.
> If they choose to help voluntarily, then they have no claim on the development of the project.
Not true at all. They have copyright to any code/docs they contribute. Things like CLAs distory this legal reality by forcing you to relinquish your rights and enabling BDFLs to act as if they personally wrote all outside code.