It's probably the ball joint like the dealer said. I had the same problem after my swap till eventually it just seperated and I had to replace it. But if you replaced both axles already than I don't know what else to suggest.