It sounds like the internal resistance of the battery is much higher than it should be. When you measure an unloaded battery with a meter, the meters input resistance is many times higher than the internal resistance of the battery, so virtually little voltage is dropped across the internal resistance and almost all is dropped across the meter's resistance.