http://www.amazon.com/Rocket-Surgery-Made-Easy-Do-It-Yoursel...
Yes. The first job of someone putting up a website new design or redesign is to do usability testing. Can a user who reaches your site by a search engine result or some friendly inbound link accomplish a relevant task upon reaching your site? If not, why not? As Steve Krug says, "this isn't rocket surgery,"
http://www.amazon.com/Rocket-Surgery-Made-Easy-Yourself/dp/0...
and if you aren't investing in making your website usable for users, related to some purpose you had when putting up the website in the first place, you might as well do without having a website.
2. Watch (in person) real people using your website trying to solve this problem. Many times. Fix the most glaring problems.
This is the best book to learn usability testing, and the only one I would recommend: http://www.amazon.com/Rocket-Surgery-Made-Easy--Yourself/dp/...
This app looks like it would work well with Krug's recommendations.