I've seen teams starting Chad Ogea and Steve Woodard, while Tom Glavine and Charles Nagy sit on the bench and get rusty.
It wasn't against me, (unfortunately ;-), but against my competition in the Wild Card race, so it definately happens, and it definately has a huge effect on the rest of the league....