I'll add my 2 cents. I have enabled and disabled File Vault on my account at least 3 times in the last couple of years, with no problems.
That said, always do backups first, in either direction!
I've heard of problems that caused data loss, so I won't say everyone should do it.
I will say...