I thought US subs didn't fly colors unless they were around friendly vessels or in port? I mean, you obviously can't run up the colors while submerged, and if you contact an enemy on the surface, what's the point in putting up a flag if you're going to attack them anyways?
