Looks like that's an independent setting for the login window, I never noticed it before.
Go to your System Preferences, then Users & Groups. Click the padlock to unlock the pane, then click the Login Options.
There's a checkbox for "Use VoiceOver in the login window".
If you don't need Voiceover at login, uncheck the box.