Since you are "thinking big", you might want to consider an approach that should achieve that desired independence from personal habits and inflections etc. -- phoneme encoding. The basic idea is that there are less than 300 phonemes used in human speech -- probably they would all fit into one...