This is a brilliant essay Fetch. Economists have battled with Bayes for decades, but only because they knew that their dogma would NOT stand the test of the Right Reverend. Atheorectical science is another kettle of fish, but it is already swimming happily with the sharks. But putting the master in the Master Algorithm is really a terrifying idea. What form might these punishments take? We have already closed our eyes, and that is the problem. Note: https://daneke.medium.com/it-is-a-thing-thing-openai-artificial-general-intelligence-and-the-emergence-of-alien-life-on-432877b548c3
Has anyone noticed that AGI is no longer about replicating human cognitive processes, it is just about leaving them in the dust.