Have you got one of the "wake when" things set?
For example, there's a box to tick in the Bluetooth prefs "Allow Bluetooth devices to wake this computer". There's others out there for other networking things - modem, fax etc.. Try a browse of your System Prefs.