Nevermind what I said, I've installed libxxf86vm-dev which added a few other dependencies and recompiled it with:make USE_SDL=0 BUILD_CLIENT=1 BUILD_CLIENT_SMP=1
and moved tremulous-smp.x86 to the tremulous directory and ran it and it finally worked!
Annoyingly enough though, sound has stopped working, maybe because of disabling sdl, Im not sure. Thanks next_ghost and everyone else for the SMP thing.