This book, http://www.amazon.com/Compiler-Generator-Automatic-Computati..., which by today's standards is not a very good book, got me started in my compiler career.

And I agree with your basic point that building one is the only to gain true understanding.