I think that the recovery rate is set up to prevent overwork.
Say you have a reliever that worked 50 innings and can face 10 batters each outing. Without a recovery factor at all, he could conceivably be used up in a single series. So, the recovery rate forces the manager to spread out usage. In general, lesser total innings with higher batters faced should result in longer recovery rates.
Just a WAG though