Removing rivets is easy once you have removed a few hundred. Please don't ask me why I am so proficient :).
So if you know the size of the opening, use a drill just slightly smaller than the hole. This is a precaution in the event you actually do drill out the rivet.
Start the drill dead...