They couldnt know for certain, but by listening via hydrophones they could hear noises that would indicate the submarine has been damaged and is sinking (hissing, clanking, twisting of metal, metal hitting the bottom etc.) and another way would be visually scanning the sea surface for any wreckage and oil the submarine could've spilled when damaged.
Welcome aboard.
