> market incentives pretty much always go opposite of moral incentives because morals put breaks on decisions that multiply value for the company
Yes, both market and morals have to be defined and are subjected to some rules and conventions - as you mention correctly in the reply. What I think it could be more qualified is the market and moral incentives "always go opposite".
Even today in many countries the market ensure a lot of necessary things for a lot of the population. Not all topics can be managed as a market (for example I don't think healthcare or basic infrastructure fit) and not in all countries have such frameworks, but given the successful examples I think it's more about wrongly using the tool than due to the tool itself.
Regarding your examples (Palantir, Claude - guns/surveillance), the same things happened in places where market incentives are/were not a driving force (communist East Europe/China for surveillance, quite probable China for automated weapons).
Honestly I wish I could propose/explain what would help. But just blaming a generic tools that we have (market, AI, press) for the bad things resulting from incorrect usage, worries me, as it can lead to not using them even when they would work.
> market incentives pretty much always go opposite of moral incentives because morals put breaks on decisions that multiply value for the company
Yes, both market and morals have to be defined and are subjected to some rules and conventions - as you mention correctly in the reply. What I think it could be more qualified is the market and moral incentives "always go opposite".
Even today in many countries the market ensure a lot of necessary things for a lot of the population. Not all topics can be managed as a market (for example I don't think healthcare or basic infrastructure fit) and not in all countries have such frameworks, but given the successful examples I think it's more about wrongly using the tool than due to the tool itself.
Regarding your examples (Palantir, Claude - guns/surveillance), the same things happened in places where market incentives are/were not a driving force (communist East Europe/China for surveillance, quite probable China for automated weapons).
Honestly I wish I could propose/explain what would help. But just blaming a generic tools that we have (market, AI, press) for the bad things resulting from incorrect usage, worries me, as it can lead to not using them even when they would work.