what if you get off the highway before a CHP stops you? does he still have the right to give you a ticket?

And we too have provincial police and they have the right to give you a ticket anywhere they want... just wondering if its the same.