Are they plugged into the correct port on the back of the computer? It's easy to confuse the microphone port with the speaker port, if your G4 is older.
Also, in the "Sound" pane of the System Preferences, under "Output," is the correct output selected?