You could kill your synchros which would make your shifts a lot harder. You could also damage the gears themselves, to the point that you wouldn't be able to shift into that gear.