I'm not getting it; missing something somewhere...
I have the same issue, and disabling EPSV does not fix the situation for me.
I am using a PowerBook, Tiger 10.4.3, using Terminal to FTP to a Linux machine, and the ls command times out regardless if I have passive mode on or off, and EPSV...