Interesting that the backbone behind the thing is just plain ethernet (Gigabit ethernet, to be sure, but still). Nice to know that Ethernet performance is high enough these days that it can be used for a credible supercomputer backbone.
Used to be you couldn't ever get the sort of performance you'd need without some weirdass network stuff like myrinet. I guess it depends on the sort of problems they're doing, how much traffic actually has to move around to keep things synchronized.