A group of guys, all wearing several pieces of the same color clothing, roaming down the street and harassing a guy and his girl walking a dog pretty much defines the meaning of "gang".
You're right. It just seems like he made the assumption before they started harassing him. My bad.