Have you modified Apache in any way? Installed a newer version, perhaps?
If yes, then you've probably got two Apache servers running or not running: the built-in, Apple-supplied Apache web server, and the Apache web server that you installed (if'n, in fact, you did).
Apple's Apache is partly installed in non-standard locations, in terms of UNIX directories and such. If you installed another version of Apache, then you probably installed in alongside the built-in Apache, rather than over the top of it.
Also, if you did this, then the Sharing system preference will control Apple's Apache only, while you'll have to start and stop your installed Apache from the command line.