Properly mounted the vibes or shakes don't hurt them. As for dedicated buttons it's a non issue unless you are trying to operate the phone while riding.
Stop, use phone or set route and then ride, using ear buds or speakers to hear directions. Keep your eyes on the road. Works for me without any issues.
Like any technology, use it so that it doesn't intrude or distract your riding and everything is okay.