Use the multimeter and read the voltage on the capacitor leads. The voltage should read near 9 volts. The voltage will discharge rapidly to 0V because the capacitor is discharging through the multimeter. If the capacitor will not retain that voltage, it is defective and should be replaced.