Is your steering wheel centered correctly? If it isn't perfectly straight/lined-up when the car is traveling straight down the road, that's the problem. Regardless of any possible alignment issues (pulling to one side), the wheel should be centered when the car is going straight.
Otherwise I'd take the cover off the column and have a look :shrug: