Well, let me just say this: I raced a bone stock 2002' (?) SE-R in my I/H/E GSR last year and I was barely able to pull on him half-way through 3rd. This was at SacTown Raceway of course. Also, by the term "pulling", I meant he was AHEAD of me and I was just starting to catch up before we ran out of track.
So...like I said before, just don't let him bother you too much. There are always faster cars out there driven by "tough guys" who think they're king of the road.
Shingo