Keep it. The day you forget to hook up the stand, the last thing you'll think as you head for the rock-cut is 'I wish I hadn't removed that switch'.
In getting close to 100,000 miles on my Eldorado, I've fallen off precisely twice: once while riding on a slippery track, and once when I forgot the sidestand and it drove me into a ditch. Others have been less lucky.
Thinking that you can flick it up with your foot if you forget doesn't work.
Nick