Just leave as much gold on your char as you actually need.
IF your walking around with 500k in your pocket, not like your gonna spend it all at once. The more gold you have (on you) the more that can be potentially lost.
I would say keep 50k and stash the rest of it away till you actually need it (selling, tcg mount, etc). Its not like day to day costs THAT much.