I'm having exactly the same problems. We have 2 Xservers and about 15 clients G5's. Retrospect runs well on all except the main server. After a while the connection is dropped (still controllable through Remote Desktop though) but the backup stops.
I've done the same thing using ChronoSync...
