Yeah I wouldn't do that too much. Honda says in their manuals that you can do it, but if you want to keep the car for awhile just leave it be. It's faster to leave it in drive, then to go through the gears yourself.