There's an acronym (one of many millions I suspect) in some fields of computer programming:
TMTOWTDI or "TimToady".
I'm not going to lay out what it stands for exactly, just to point out that whatever works for you is the right thing *as long as* it isn't dangerous or downright stupid.
Personally, being vertically challenged, I will carry an extinguisher generally with my right hand with the handle facing backwards. It works for me, and if it's a long way I have another one on the left that can help