That green thing is just a rubber insulator to keep them safe. There's no significant harm that would come to the car if they were just dangling, but I'd plug it back in just to keep them safe from lazy passengers...