This will be nice if we can modify the response so we don't have to say To Do, I wish they make it an open standard or allow us to forward the requests to a URL of our choice as well. As far as Android Wear, I have been able to setup TASKER commands using MobiLinc to control my house. Since I have that setup, I also used AutoVoice to trigger the Tasker Commands based on what words i use.
Ex: OK GOOGLE triggers Android Wear or your Phone to listen, then i say "Turn Living Room Lights On." When AutoVoice recognizes that, it triggers Tasker to send the command to MobiLinc and it turns the lights on. You can also setup Tasker to send a direct API command to a URL of your choice instead of using MobiLinc as that would be faster.