That is a brilliant idea! Using 5-9 could help a lot.
Even if you rebind weapon keys, say to mouse buttons, even clicking the mouse will "accidentally" vote for something. And since there is no button...
The RTV system is fine. I do have a suggestion for voting in general: Instead of 1,2,3,4 use F1,F2,F3,F4. The problem with using numbers is...
Separate names with a comma.