Yeah, that sounds good. I did it with my front lip before like that also. You gotta sand it to give it some texture for the primer to "hold on to" I didn't sand all the paint down to the rubber though.