I asked them about this and they said it'll still work to turn them on without the app (your assumption about flicking the switch is correct).