I think disabling and re-enabling Leader Plugin fixed the problem, which is really weird... I'm not 100% sure though. I have only tested it on two drops so far, and not in a Dungeon yet. May be worth your while to test that when you try and replicate the problem though.