Absolutely. Wonderful book that talks about this in a different context https://www.amazon.com/Why-Greatness-Cannot-Planned-Objectiv...

Also wrote about it here https://blog.comini.in/p/what-should-replace-grades

We should ask, when will AI make a discovery on its own? For instance, computers should be able to understand numbers, and run analysis on numbers. Computers have complete access to every fact that humans know about numbers. So numbers should be the first place that we should expect to see genuine innovation from AI. This is a simple test for the moment that AI is able to make original contributions to our society: when can AI come up with a new thesis about numbers, and then build an original proof, something that can be published in the major, peer-reviewed math journals.

Until AI can do that, we have to admit that it's not really aware or sentient or any of the other more ambitious things that have recently been claimed for it.

Can AI teach us anything new about the pattern of prime numbers?

Can AI develop an original proof for the shape of shadows in high dimensional spaces?

Can AI creatively prove a new limit to mathematics?

There are 2 researchers in AI who deserve more attention: Kenneth O. Stanley and Joel Lehman. They wrote a great book: Why Greatness Cannot Be Planned. They look at the limits of utility functions and explain the importance of novelty. As an antidote to some of the hype around AI, I strongly recommend this book:

https://www.amazon.com/Why-Greatness-Cannot-Planned-Objectiv...

I recommend this book https://www.amazon.com/gp/aw/d/3319155237?psc=1&ref=ppx_pop_... . It makes a clear case why trying to aim certain objective, when it comes to innovation, doesn't necessarily work and we still need "aimless wandering" and the pursuit of pure knowledge is a good guidance when it comes to that.

I am surprised this book is not mentioned. Talks about how optimization doesn't lead to optimal goals in complex environments (e.g. life).

https://www.amazon.com/Why-Greatness-Cannot-Planned-Objectiv...

This is a good book on the subject: "Why Greatness Cannot Be Planned: The Myth of the Objective" https://www.amazon.com/Why-Greatness-Cannot-Planned-Objectiv...

The kindle version on Amazon [0] is slightly cheaper at $16.19.

[0] http://www.amazon.com/Why-Greatness-Cannot-Planned-Objective...

Kenneth O. Stanley and Joel Lehman have a great book out on measuring novelty, and using it to search large parameter spaces for interesting behaviors.

http://eplex.cs.ucf.edu/noveltysearch/userspage/ http://www.amazon.com/Why-Greatness-Cannot-Planned-Objective...

I'm a big fan, and would love to talk about this anytime.