https://www.amazon.com/Game-Engine-Architecture-Engineering-...

Not only is this a fantastic introduction to the math and the data structures involved in computer graphics, the book also walks you through the construction of an in-software renderer!