Just wet sand it using various grits. The final one should be very fine.

I wouldn't use chemicals to get the paint off. They might make the plastic look bad.