It's a feature. I'm with you, however I never did like it. I always thought it should have been a slide out box like in Mail (mailbox) or like in Omniweb (bookmarks). In fact, I would like to see this instead of any floating toolbar option.
Microsoft just really doesn't really get it, not even in their highly acclaimed Office X. The icons are even worse....arghhhhh.