- [0] Pattern Recognition and Machine Learning (Information Science and Statistics)
and also:
- [1] The Elements of Statistical Learning
- [2] Reinforcement Learning: An Introduction by Barto and Sutton
- [3] The Deep Learning by Aaron Courville, Ian Goodfellow, and Yoshua Bengio
- [4] Neural Network Methods for Natural Language Processing (Synthesis Lectures on Human Language Technologies) by Yoav Goldberg
Then some math tid-bits:
[5] Introduction to Linear Algebra by Strang
----------- links:
- [0] [PDF](http://users.isr.ist.utl.pt/~wurmd/Livros/school/Bishop%20-%...)
- [0][AMZ](https://www.amazon.com/Pattern-Recognition-Learning-Informat...)
- [2] [amz](https://www.amazon.com/Reinforcement-Learning-Introduction-A...)
- [2] [site](https://www.deeplearningbook.org/)
- [3] [amz](https://www.amazon.com/Deep-Learning-Adaptive-Computation-Ma...)
- [3] [pdf](http://incompleteideas.net/book/bookdraft2017nov5.pdf)
- [4] [amz](https://www.amazon.com/Language-Processing-Synthesis-Lecture...)
- [5] [amz](https://www.amazon.com/Introduction-Linear-Algebra-Gilbert-S...)
For general machine learning, there are many, many books. A good intro is [1] and a more comprehensive, reference sort of book is [2]. Frankly, by this point, even reading the documentation and user guide of scikit-learn has a fairly good mathematical presentation of many algorithms. Another good reference book is [3].
Finally, I would also recommend supplementing some of that stuff with Bayesian analysis, which can address many of the same problems, or be intermixed with machine learning algorithms, but which is important for a lot of other reasons too (MCMC sampling, hierarchical regression, small data problems). For that I would recommend [4] and [5].
Stay away from bootcamps or books or lectures that seem overly branded with “data science.” This usually means more focus on data pipeline tooling, data cleaning, shallow details about a specific software package, and side tasks like wrapping something in a webservice.
That stuff is extremely easy to learn on the job and usually needs to be tailored differently for every different project or employer, so it’s a relative waste of time unless it is the only way you can get a job.
[0]: < https://www.amazon.com/Deep-Learning-Adaptive-Computation-Ma... >
[1]: < https://www.amazon.com/Pattern-Classification-Pt-1-Richard-D... >
[2]: < https://www.amazon.com/Pattern-Recognition-Learning-Informat... >
[3]: < http://www.web.stanford.edu/~hastie/ElemStatLearn/ >
One thing I'll do once in a while is visit a university bookstore to get a sense of what's being used in classrooms. I ended up with a lot of my law textbooks like that. In law, I've really loved:
- Canadian Administrative Law (Guy Régimbald): https://store.lexisnexis.ca/en/categories/shop-by-jurisdicti...
- Tort Law (Horsey & Rackley): https://www.amazon.ca/Tort-Law-Kirsty-Horsey-dp-019886776X/d...
- Handbook of Canadian Higher Education Law (Shanahan, Nilso & Broshko): https://www.amazon.ca/Handbook-Canadian-Higher-Education-Law...
I've been on a maths, stats and ML/AI binge in the last year, and so far my top picks are:
- Calculus (Stewart): https://www.amazon.ca/Calculus-James-Stewart/dp/1337624187/
- Linear Algebra Done Right (Sheldon Axler): https://www.amazon.ca/Linear-Algebra-Right-Undergraduate-Mat...
- An Illustrative Guide to Multivariable and Vector Calculus (Miklavcic): https://www.amazon.ca/gp/product/3030334589/
- Probability: A Graduate Course (Allan Gut): https://www.amazon.ca/gp/product/1461447070/
- Statistical Rethinking (McElreath): https://www.amazon.ca/gp/product/036713991X/
- An Introduction to Statistical Learning (James, Witten, Hastie & Tibshirani): https://www.amazon.ca/Introduction-Statistical-Learning-Appl...
- Regression and Other Stories (Gelman, Hill & Vehtari): https://www.amazon.ca/gp/product/1107676517/
- Data Analysis Using Regression and Multilevel/Hierarchical Models (Gelman & Hill): https://www.amazon.ca/gp/product/052168689X/
- Statistical and Data Analysis for Financial Engineering (Ruppert & Matteson): https://www.amazon.ca/gp/product/1493926136/
- Reinforcement Learning (Sutton & Barto): https://www.amazon.ca/Reinforcement-Learning-Introduction-Ri...
- Deep Learning (Godfellow, Bengio & Courville): https://www.amazon.ca/Deep-Learning-Ian-Goodfellow/dp/026203...
- Networks (Mark Newman): https://www.amazon.ca/Networks-Mark-Newman/dp/0198805098/
I have a ton of textbooks in my wishlist that seem noteworthy and interesting, but that I haven't gotten the chance to read yet: no promises, but you might find something in there https://www.amazon.ca/hz/wishlist/ls/1FWW046Q3RWWM
My area of expertise is biochemistry, life science, immunology, cell bio... So if anyone wants good recommendations in these topics I have plenty! :)