Vonage is the culprit here...
I would put a hub/switch between ....so
cable modem --> hub --- vonage
Vonage will appropriate as much pipe as it thinks it needs slowing the rest of your network. with a hub (I recommend a switch) your ftp speeds and everything else will improve.