First of all, that idea is absolute genius.
But I can't see much use for it in Tremulous, a FIRST-PERSON shooter. This would be absolute gold for RTS games, or even for just plain Third-Person games. But it really isn't worth the trouble for FPS games. Even for grangers, that's like having one insanely expensive monitor just to be able to build structures. o_O