I guess for the major part of the time they were more like a guild. Building temples requires very special skills; they say they aim at 1000 year duration, even though those temples are made of woods, instead of stones. It requires many years of apprenticeship, and probably becoming a member of their family was the only way to master the profession, thus there weren't much competitors. On the other hand, temples had always been built and reconstructed.