There’s a built-in design paradox. How does a judge assess an expert in a field where he is not one? There’s probably some improvement that comes from experience but it’s not perfect.
Qualifications=academics usually & career experience. No way to know if they actually learned something and aren’t a fraud. Even corporations that do thousands of interviews get duped
- perhaps the judge make less experts interviews than the corporations, leading to less experience in that but also takes each of them more seriously.
- one way to remove/add some credit to someone claim is to ask some of their peers opinion and see if there’s a strong majority.
- the judge personal expertise may help him forge a precise opinion but that wouldn’t clear him of making a mistake.
For important matters it’s always a good idea to ask for peers reviews. Academics knows that too.
Opposing lawyers have an incentive to help the judge. Of course the lawyers will lie, but they still will point out important details for the judge to look at.