I would use an alcohol based cleaner. Unless they are plastic. How is dirt getting inside of the headlight assembly?