I don't know if I actually saw this on a movie, or heard it in a joke, but you could (this sounds a bit painful though) sellotape your penis to your thigh. lol.

In the movie/joke I got this from, someone ended up getting kicked in the face, so I don't know if it would work, lolal.