one of the things with dungeon buddy, and a routine that does not have movement logic and rest behavior in it. Dungeonbuddy(if i am not mistaken) completely overrides the combat routine when it needs to handle movement. So, if you have iwantmovement plugin which i assume you are since oracle does not handle any movement.
Iwantmovement inserts itself into the combat routing as a movement source....so if you need to move, facetarget that sort of thing it takes over where the routine normally would. Now with DB, if it needs to move you out of anything or to a certain location it completely halts the combat routine to do this. Thus like you are stopping oracle. Now when you first start oracle or an encounter it always takes it a second to initialize. This to me is amplified every time DB tries to move you.
Now I may be completely wrong with this, but that is my theory on why it pauses so much for trash and bosses with dungeonbuddy.