I can however access files via other ways, such as recent items, etc. So it's not hard drive failure. Should I just reinstall 10.3?
EDIT : Ok guess what it was : My iPod! It's done something else annoying before, but this is just crazy. I removed it from it's dock, and bam, my finder comes...