In my experience, it seems that if you leave a tired pitcher in, he'll be ineffective for 4 batters or so, but then will be pretty effective after that.
Of course, he's probably given up 2-3 runs before then, but if you're trying to save a bullpen, it doesn't seem to hurt to run a pitcher down to -10 or so.