The book cited above is to help with 1. and 2. in your list.
YouTube video: Edward de Bono 'How to have a beautiful mind' at Mind & Its Potential, 2011 https://www.youtube.com/watch?v=SbsKQQGwsMg
The video above features Dr. Edward de Bono talking about the thinking processes and creativity.
Edward de Bono, the person who coined the term lateral thinking, lists random juxtaposition as one of the tools for spurring creativity. [1], [2]
In his Six Thinking Hats [2], he writes about 6 different modes of thinking coded by colored hats.
- Blue hat: Organizing
- White hat: Information, facts, stats
- Green hat: Creative ideas
- Yellow hat: Benefits and positives
- Black hat: Caution, risks, negatives
- Red hat: Emotions
He asks us (a team) to look at a problem (he calls it Focus. For e.g., Focus: AGI in military use) wearing one hat at a time. So, when we all wear White hat, we bring data, citations, previous relevant work etc., We don't expend energy in evaluating this data at the moment (that comes later when we wear a different hat, i.e., the black hat).
His theory is that we can think better with the Six Thinking Hats method.
So, applying this analogy to LLMs, hallucinations of LLMs can be thought of as the LLM wearing a green hat.
A theorem prover or fact checker can be added to act as a black hat. (LLMs themselves are capable of doing this critical review -- for eg., list 5 points for and against fossil fuels).
Extending this analogy further, we have tools like LangChain [3] that are focused on the organizing bit (blue hat), ChatGPT plugins that provide up-to-date information, run computations or use 3rd party services (white hat).
Green and Yellow hats are out-of-the-box supported by LLMs already.
Red hat is a sentimental analyzer (which is a classic machine learning algorithm) that LLMs already subsume.
So, it is just a matter of time before this gets refined and more useful that we don't have to worry about the hallucination coming in the way.
[1]: https://www.amazon.com/Serious-Creativity-Thoughts-Reinventi...
[2]: https://www.amazon.com/Six-Thinking-Hats-Edward-Bono/dp/0316...
[3]: https://github.com/hwchase17/langchain