From the Official Rules of Baseball:

3.05(b) If the pitcher is replaced, the substitute pitcher shall pitch to the batter then at bat, or any substitute batter, until such batter is put out or reaches first base, or until the offensive team is put out, unless the substitute pitcher sustains injury or illness which, in the umpire in chief's judgment, incapacitates him for further play as a pitcher.