I thought the low appearance factor applied to both pitchers and hitters. Thus you are correct. I'd change the rule so pitchers have a 5 inning min. rule.

The good news is this usually only affects 2 or 3 players, and for 1 or 2 games only.(if that is any consolation).