I have found psychology books to be rather interesting in understanding social engineering.

http://www.amazon.com/Mistakes-Were-Made-But-Not/dp/01510109... http://www.amazon.com/Lucifer-Effect-Understanding-Good-Peop...

..You get the idea.