Yes, in System Preferences > Network > Proxies.
The problem is, as with other non-apple apps, Entourage doesn't seem to be taking them into account (like Safari vs. Firefox - after I changed the proxy in the sys prefs, I still have to do it manually in Firefox, while Safari takes the changes...