Seriously, there needs to be a "blank" equipment slot where you hold nothing and are able to punch. That would be awesome. Heck, maybe they could make it so you could grapple with aliens and hold them, basilisk-style.
On a more on-topic note... you didn't fool him, he saw your brass knuckles.