It will turn out to be a system caching issue, I'm sure.
AFAIK, the file com.apple.systempreferences.plist should be the file that stores the position settings for the app window.
It can take several attempts at removing that file (restarting each time) until the caching should correct itself.
You could also try one of the specialist maintenance apps that offer to do deep cache cleaning/resets.
OnyX is one, or ElCapitan Cache Cleaner, etc.
Another possibility - and if this remains totally annoying to you, that an OS X reinstall will fix.