Hello Florian,
I don't know much about it, but MacSpeech Dictate has a fantastic speech recognition engine and I wondered about whether or not the handy DSL you've built could be used to build commands for MacSpeech. Consider this a request for additional research on using open source or paid speech recognition software to increase the accuracy of james.
Cheers,
Devin