OK, If I just install XFree86, I can get it working with:
startx -- -quartz -keymap USA.keymapping
Once I install XDarwin, it launches in rootless just fine using the same command line.
But I can't double click XDarwin App even though I have the keyboard mapping selected in preferences...