I don't think you even need everyone to be remote. I've noticed that its enough to just have two separate offices with teams that have a mix of employees between those two offices.

Once you have that, adding people that are fully remote becomes almost trivial, since you are already accounting for most cases where people aren't always in a single space.