--Computer Organization--:
Computer Systems: A Programmer's Perspective http://www.amazon.com/Computer-Systems-Programmers-Randal-Br...
I liked this much better than Computer Organization and Design by Patterson and Hennessy which everyone has encountered at some point. The developer-centric view was very cool.
--Computer Security--:
Kernel Exploitation: Attacking the Core http://www.amazon.com/Guide-Kernel-Exploitation-Attacking-Co...
Most 'hacking' books are goofy. This one is very good and doubles nicely as a hackers operating systems text.
Web Application Hackers Handbook http://www.amazon.com/Web-Application-Hackers-Handbook-Disco...
Very nice overview for web concerns.
--Operating Systems-:
Operating System Design and Implementation http://www.amazon.com/Operating-Systems-Design-Implementatio...
I don't agree with Tanenbaum's views on micro vs. monolithic kernels but this book is a great mix of theory and implementation.
Linux Kernel Devleopment http://www.amazon.com/Linux-Kernel-Development-Robert-Love/d...
I used this to get a feel for the monolithic implementations of topics covered by Tanenbaum.
--Networking--:
TCP/IP Illustrated Series. More than you would ever want to know.
...if you're interested in the kernel level exploits.
disclaimer: A co-worker of mine co-authored it.