There is no on/off button, only "mute". In some circumstances, if you mute, it won't remember that setting and start the radio at the set volume when you turn the car on.
It should remember the mute setting, and hopefully will be fixed in an OTA update. In the meantime, turning the volume knob to "0" works quite well.
