You can change these settings in your browser preferences.
Windows Media Player isn't half as versatile or effective as QuickTime, though (I use both, but WMP only for playing its own files), and I'd leave QT for playing .mov files, at least. Don't remove it, as it does many things at a system level.