It woun't hurt anything by leaving them in, you'll just have that vibration at idle. That can be fixed by raising your idle a little like 2.2 was saying.