Under the valve cover are seals that keep the oil from leaking into the the spark plug housings. You should replace them to or else the same problem will probably happen again.