If it was me and you have another small speaker I would connect wires to the spare speaker bear the wire back a bit and touch both wires to the speaker connections in the box with out removing it. May not be the speaker, if the original speaker is not damaged or torn it's probably not the speaker.
Cheers Arry