Batteries have a finite current capacity. As you approach it, their voltage drops. 9V batteries already have a ridicously low capacity as it is, so a dead one is even worse.
9V alkaline batteries are designed for small loads, less than 30mA. AAs and larger do much better with larger loads.