I don't have any smart crap in my house, but ordinary bluetooth speakers routinely have a very noticeable latency between when a command is given on a connected device and when the speaker responds, often around 1-3 seconds. Its more of an odd quirk than anything to be concerned about unless you are constantly changing what is playing, then the cycle of input, wait, input, wait, input, wait could be annoying. (Or more realistically someone doing this loses patience and starts giving multiple inputs faster than latency allows the speaker to react, then gets upset when they inadvertently give the wrong commands)