If it were wheels out-of-balance, it should do it even when you're not accelerating.

Ball joints like he said, but usually they make a clunking sound.

I'd guess maybe inner drivers? Maybe even damaged tires? Swap your wheels front-to-back, see if it changes. If it changes, then look for damaged tires or bent wheels. If it doesn't change, then CV joints or inner joints.