I used to boot Windows on Bootcamp, but have since deleted the partition. The Laptop still tries to boot Windows on startup and I was wondering how to stop this.

Boot to OS X, then open System Preferences. Then choose Startup Disk pref pane.
Select your OS X boot partition. Then close the System Preferences. That should be all that you need to do.

Thanks that did the trick. :)