We don't really know this with such certainty. Our records have gaps and only extend a few thousand years back, at most. Even then, we often only have bits and pieces for certain populations. It's a large stretch to generalize over human history.