When you are receiving access denied errors, does sshd log anything interesting to /var/log/system.log? Specifically, does it claim something to the effect of your username being illegal? If so, I've seen that myself, but have yet to figure out a fix to it...
If not, what, if any, errors...