I think it's important to keep track of which particular wealth we create and how it gets distributed. If eg GDP grows 2x, but instead of affording 2x more food everyone can now afford 10x more/better memes and better drones for their country military, I don't consider it a win. In other words, "growing wealth" means better access of people (on average) to some resources, but whether it's a good thing depends on the exact resources the world gains.