If the front tires are different, try rotating them to the back and see if that makes a difference. If it does, you know what the problem is and if it doesn't, you've only spent about 10 minutes rotating tires.

How do you know for sure it's not torque steer?