They kind of did. Mammoths and such existed for a very long time and it seemed like life on earth was big, not as big as in the time of the dinosaurs, but a lot of creatures were getting quite large akin to them.

Humans then left Africa and killed them all off. Our environmental niche seems to be perfect for hunting and killing big grazers.

It's our world now!