sounds like transmission side... you definately should have that leak checked and your fluid levels checked. if you are running short on fluid it could be the cause.
it could be that the initial grabbing of the inner clutches is bad thats why you have a clunk when its going from slipping (you holding brakes) to giving it gas (grabbing).
or yea, get under the car and look at the CV boots.