it wouldn't leak into your oil, you'd be burning off the coolant and blowing white smoke out the tailpipe. You may even see some bubbles around the head/block mating area when it's running.

It could also be that you had bubbles in the line that have now worked their way out.