I don't have that window problem. My Windows stay where they should be. Try opening the Apps window _not_ from the alias, then close it, then try again from the alias.
Never mind...I found a workaround. I move the window to where I want it...and resize it (doesn't have to be big...1 pixel will do)...then I close the window and it remembers. Weird.