Roll the hat on it's brim up over the back of your hand and wrist.
Hold the hat in an outside grip and swing it round so it rolls up on to the back of the hand. Twist your hand round to catch it as it pops off again.
This works in both dierctions with both hands - so you may as well learn all the variations!