I get that when stupid apps like gaim decide they just *must* have the input now, and do a bad job of getting it. They get the focus, but not the mouse, leaving you screwed.
Also, you don't need to restart, Ctrl-Atl-F2 and killall tremulous.x86 should work, if not Ctrl-Alt-BackSpace will restart X.