Wheel & tire weight affects you just like vehicle weight. But it goes like this...

One pound of weight right at the center of the wheels is worth exactly the same as one pound of extra junk in your backseat.

One pound of weight located at the outside of the wheel is worth the same as TWO pounds of junk in the backseat. This would be, for example, heavier belts in the tire.

Since the weight is really distributed in between the hub & the tread, then it's worth somewhere between 1x and 2x times the deadweight.

You can't just compare the weight of 15" against 16" or 17" wheels. The tires to fit those wheels also weigh different.

The slip ratio of the tires themselves also matters. A lot. But that's not about their weight.