I've got these nice little wool gloves, but it's made from very fine wool and has rubber prints on the tips so it glues to my mouse and keyboard, they've never let me down. Sometimes when I want to really immerse myself I wear a balaclava. Or I make sure I'm gaming inside a room with a aircon.
