No, the oil will not do anything immediately. When enough oil builds up down there it'll short out your spark plugs. Maybe it'll produce arc tracks in the ends of your plug wires so they keep shorting after you wipe off the oil.

Maybe you can figure out how often to pull off the wires, clean them up & clean up the bottom of the spark plug tubes, so the oil never builds up enough to do any damage. Every 5 weeks? Every 3 days? Then you can just keep doing that until you get tired of it.