For #2: In my experience, it takes a long time to go from "the basic question" to a well-founded statistical question for which analysis is appropriate.
For #3: The best managers and analysts will find ways to ask questions and meet in the middle between technical complexity and the business/science problem at hand.
http://www.openintro.org/stat/textbook.php
It's a free online statistics textbook, also available in print. I haven't used it extensively, so I can't vouch for its quality -- actually, I complain about it a bit in Statistics Done Wrong. But I've never come across a very good conceptual introduction to statistics, so this is roughly the best I know.
There are also amusing variations, like the cartoon guide to statistics:
http://www.amazon.com/Cartoon-Guide-Statistics-Larry-Gonick/...
If you find a useful resource, I'd like to hear what worked for you.
You do not even know the memory load, what was running at the same time on the server, etc. It is like throwing one blue dice and one yellow. You get a six on the first and a three on the second and consider through your not terribly scientific benchmark that you get more with blue dices.
Recommended reading for the author: http://www.amazon.com/Cartoon-Guide-Statistics-Larry-Gonick/...
Not a joke, this is a really good book about the test side of the stats.
http://www.amazon.com/How-Lie-Statistics-Darrell-Huff/dp/039...
http://www.amazon.com/Cartoon-Guide-Statistics-Larry-Gonick/...
I haven't had a chance to check out the manga guide to statistics but that might be a decent introduction, as well.
http://www.amazon.com/Cartoon-Guide-Statistics-Larry-Gonick/...
https://www.amazon.com/Cartoon-Guide-Statistics-Larry-Gonick...