That's all it takes. I do not have OS 9 instlled on any of my personal machines or on any of the ones I support and have never missed it in over a year.
Remove "System Folder (OS 9)" and "Applications (OS 9)" and you're done. Be sure there's nothing in either of those folders that you want to keep, though.