You're not doing anything wrong.
Sadly, the bounties are just buggy. Act 5 especially. Death Gates give the bot a real hard time as well as the Corrupted Growths. There's tons of posts around here about issues with the bot. Including the one with Belial that you spoke of...