On your left speaker, your negative factory wire is gray with a black stripe, so whichever color wire connects to that wire is your negative (be it black or white)

On the right speaker your negative is brown with a black stripe.

Either way, it should not affect it that much... if you have rear speakers then you could get some cancellation if your polarity is off. If you don't have rear speakers then there will be absolutely no difference.