Fingers crossed, I may have found a fix. Changed from two word scene spoken name, living room, to single word scene spoken name - lights. Now both on and off commands seem to work OK.
When in doubt, try to go with single word names for your devices and scenes.