Well, you are talking about rearranging several thousand files (my boot partition has 122,395 files taking up 7.3 GB on it). It's bound to take some time.
I don't know how long it's supposed to take, but in my experience, an average Windows box takes at least a couple hours to defrag. It...