I wouldn't go out and purchase a new router at this time. There may be nothing wrong with the one you have. Also, I noticed below that Chris said a new router was being shipped to you free of charge. I just don't want you to spend money on something that you don't need to spend it on.
I also see you said you ran some tests with the computer directly connected to the modem with a LAN cable (NO ROUTER) and stated that it made no difference. If this is the case, this would indicate problem isn't with the router.
Bottom to top, the top being the most recent. Interestingly, the 22.4 second test was done with Chrome, and the three subsequent tests were retests with Chrome. Then the 17.9 second test was with IE, and the four subsequent tests were retests with IE. So, the first ones are taking a while, but the retests are pretty speedy (yes, caching). That 22.4 and 17.9 are pretty high. With this said, though, I haven't noticed any problems with browsing or anything. My speed right now is 30.1Mbps and latency is 610.
To add, I'm just giving my results. I'm not having any problems.