Well for how long has this been going? This happened to me once and it was my synchros. It didn't grind at first, but a few weeks went by and sure enough it started to grind. My shifting fork was also broken. Maybe it could be as simple as just checking the tranny fluid. You could go ahead and change it. It's a pain in the ass on a manual tranny though.