Sometimes this is called "the unreasonable effectiveness of mathematics"---if you want something to Google for. I feel like the order of the world is vaguely miraculous.
You might also want to read about Euclidean and Non-Euclidean geometries and the history of the parallel postulate for how humans have grappled with this question in the past, and how our thinking has evolved in the last 150ish years. This is a fantastic book with a mix of math, philosophy, and history:
You might also want to read about Euclidean and Non-Euclidean geometries and the history of the parallel postulate for how humans have grappled with this question in the past, and how our thinking has evolved in the last 150ish years. This is a fantastic book with a mix of math, philosophy, and history:
http://www.amazon.com/Euclidean-Non-Euclidean-Geometries-Dev...
(I'm sure you can find a used copy for a lot cheaper than that link!)
It's sort of an open question whether mathematics is invented or discovered.