If your audio equipment is grounded, you should use balanced audio and preferably a common grounding point to avoid noise.
Using high quality cables may also be important if they're of some length.
Disconnect unused cables. Depending on the audio equipment, they may work like noise antennas...