Turpentine comes off with any soap, and even with just water... though not as well as one may like. Due to the petroleum base... the best way to remove it would actually be to cover your hands with dirt, or any other dry material, and then wash them.
God I know lots.