I think the point is that fertilizer makes it possible for big agriculture to operate at a certain scale.

If we didn't have fertilizer, farmers would be tending to smaller plots and using locally available fertilizers, such as locally available compost and mulch.