Thank you for asking. I find this stuff super interesting. I write about it on my blog

https://ravinkumar.com/

and here's a video for the most common question I get about bayes vs frequentist

https://www.youtube.com/watch?v=foSPfzYs4yY

For recommendations here's my suggestions split by persona

* I want a PHD in statistics or to write novel research - Go read BDA3 cover to cover. Gelman etal are amazing, and amazingly brilliant. The book is dense though, even after years of experience I need to now read chapters 2 or 3 times and write out proofs

* I want have a smooth on ramp into Bayesian stats with lots of code and beautiful writing. I also like video lectures and undergraduate college courses - Statistical Rethinking. As noted below Richard does a wonderful job explaining these concepts with metaphors like golems, interspersing it with this experience as an anthropologist, and using his teaching experience to write well structured introduction into Bayesian stats. This book does assume you understand basic statistics and probability theory.

* I want a great comparison of Bayesian vs Frequentist stats- This book covers both topics well, compares them fairly, and has all the proofs to back things up https://www.routledge.com/Understanding-Advanced-Statistical...

* I'm a programmer type person that likes hands on "build from scratch" using code - Allen Downey's think bayes builds up bayes theorem from Numpy arrays. He's also a brilliant instructors

* I want to read about the history and people and politics - Bernoulli's fallacy, The Theory That Would Not Die:, and Probably Overthinking it are all "non mathy" great armchair readings https://cup.columbia.edu/book/bernoullis-fallacy/97802311999... https://www.amazon.com/Theory-That-Would-Not-Die/dp/03001882... https://www.allendowney.com/blog/

* Im an applied practitioner that is focusing more on my specific problem and I need to use the latest PPLs and code to get it done - This is my book. I had to make estimations in SpaceX supply chain with some quick deadlines and I didn't have time to take an undergrad course. I also needed my code to be robust, testable, and scalable. I didn't find that other books provided this so that's why I wrote this with CRC and Osvaldo. Osvaldo and I are heavy contributors to PyMC, ArviZ, Preliz and other libraries so naturally we take a code first approach. https://bayesiancomputationbook.com/welcome.html

* (Shameless self promotion) Im a professional, I need to learn fast, and my company will pay for training - For this specific niche me and other Bayesian colleagues created an online course designed specifically for professionals. Yes it's expensive so let me plainly state no one at any point needs to spend any money to learn Bayesian stats. That being said hundreds of people have purchased this course and the feedback we've gotten on this course has been quite positive. So I want to underscore before Hacker news rips me apart. No one is being forced to buy this, if you want this style course here it is, if you don't there's many many ways to learn Bayesian stats. https://www.intuitivebayes.com/

You can sign up for the Gaussian Process course for free if you'd like https://www.intuitivebayes.com/gaussian-processes

As you can tell I'm very fascinated by generative modeling. I find it fun to think about. I also frankly find it lucrative. It's helped me job hop across some pretty cool companies and get through the Google interview. The combination of strong programming skillset with applied generative mathematics is only heating up so I feel lucky to have chanced upon it, and also thankful that many others before me put great code and reading material out there so I could learn myself.

I haven't read this particular book but enjoyed "The Theory that would not die"[1] which also details the historic conflict between frequentists and the bayesian statisticians. Not sure which is the better book but "The Theory..." has a lot more Goodreads ratings than this one.

[1]https://www.amazon.com/Theory-That-Would-Not-Die/dp/03001882...

Amazon link in case anyone is interested in that book:

https://www.amazon.com/Theory-That-Would-Not-Die/dp/03001882...

Yes, having read "The Theory That Would Not Die" [0] I too soon came to the conclusion that this seems to be what is behind the Wisdom of Crowds.

Aircraft searches are a big thing, and there's a book on how it has been applied to MH370...

[0] - https://www.amazon.co.uk/Theory-That-Would-Not-Die-ebook/dp/...

The Theory That Would Not Die [1] is a great read. It's a complete history of the fight to legitimize Bayes' theory from Bayes' original experiment through Turing and Nazi subs and beyond. Probably not the quickest way to learn the theory, but worth the read.

[1] http://www.amazon.com/dp/0300188226

It's mostly a philosophical difference between thinking of probabilities as measures of relative frequency versus thinking of probabilities as measures about one's uncertainty about the outcome. There isn't so much a huge war between them as there used to be, but if you want to read about the history of that this was a book I enjoyed: http://www.amazon.com/The-Theory-That-Would-Not/dp/030016969...

Being horribly biased in favor of the Bayesian interpretation ever since I learned it was a thing I'll give an example of places that frequentists can be wrong. People who disagree can give counterexamples. ;)

http://lesswrong.com/lw/1gc/frequentist_statistics_are_frequ...

On the other hand, some argue that certain forms of inference are invalid and that it doesn't matter if they give the correct answer or not in practice because they're invalid. Calculus was attacked on this basis early on because many mathematicians thought that taking the limit of something as it approached 0 wasn't a thing you should be able to do.