Even if they're only 1.5lbs heavier, they're going to slow you down. The engine has to work harder to get the force to the edge of the wheel.

On top of that, your gearing increased.