The Little Schemer <http://www.amazon.com/Little-Schemer-Daniel-P-Friedman/dp/02...; and
Clause and Effect <http://www.amazon.com/Clause-Effect-Programming-Working-Prog....
Also a help is that the languages they use ('use' is a more appropriate word here than 'teach') — Scheme and Prolog, respectively — are much more mathematical in nature than typical mainstream languages are.
http://www.amazon.com/Clause-Effect-Programming-Working-Prog...
For a preliminary taste, this online tutorial seems quite good:
http://www.coli.uni-saarland.de/~kris/learn-prolog-now/lpnpa...
You might also like to look at this free book: