Have you replaced your clutch recently?
My first thought is the pressure plate backing away from the flywheel.
Alternatively, it could be the sign of a worn throw-out bearing, although you'd hear it making noise.

And the transmission stays in gear, correct?
It doesn't pop out of gear... ever?