Well, everything is math, at some level. Supreme Court decisions might be. There are software packages used to day, using some "AI", to help judges determine the adequate level of punishments looking at circumstantial factors determining recividism rates et cetera [1] [2].
I believe that in the not too distant future there will be pressure to use these "magic" AIs to be applied everywhere, and this pressure will probably not look very hard at whether the AI is good at math or not. Just look at all the pseudoscience in the criminal system [3]. I believe this poses a real problem, so keeping hareping on this is probably the right response.
Trurl's machine, indeed. It insisted that the volume of the unit cube and unit ball are both the same, and 1, in all dimensions, even though it knew the correct formula for the surface of the n-ball.
Wen I pointed out that n=2 is a simple counter example, it refused to talk to me (no answer, try-again button, ad inifinitum). Well, safer than Trurl's machine.
I believe that in the not too distant future there will be pressure to use these "magic" AIs to be applied everywhere, and this pressure will probably not look very hard at whether the AI is good at math or not. Just look at all the pseudoscience in the criminal system [3]. I believe this poses a real problem, so keeping hareping on this is probably the right response.
[1] https://www.nytimes.com/2017/05/01/us/politics/sent-to-priso... [2] https://www.weforum.org/agenda/2018/11/algorithms-court-crim...
[3] https://www.bostonreview.net/articles/nathan-robinson-forens...