Definitely not too late, but it's hard to tell what you need to change in order to finally get programming without knowing more about your history. What is it that you don't grasp? The conceptual ideas behind programming? What programming does in the first place? The specifics of whichever language you're using?

Scratch (http://scratch.mit.edu) could be a good starting point for you— it's very visual and helps conceptualize programming (loops, instruction blocks, etc.).

If you have background in design/art/illustration/etc., then Processing might be for you— I recommend this book highly: http://www.amazon.com/Getting-Started-Processing-Casey-Reas/...

If you have any specific questions, feel free to send me an email or ping me on Twitter (all info is in my profile)