All the works-with-nest integrations got killed recently. Infuriated me as that was a major selling point of the platform. I used to have my lights rotate evenings when I wasn't home. Also had my outside lights activate based on nest cam motion detection. All that is gone now and they haven't improved the base services for ages. It's too bad since the hardware is all really top notch.
That's honestly my first thought reading this. I lost my faith in Google about these sort of things.