You're right. The one exception though is with Bayesian statistics you can estimate an effect size using your experiment results using a credibility interval.

If the differences are drastic enough you can still get value from split testing. Incremental changes are just probably not going to bring you much luck.