If you're really concerned, use a two bucket method.

One bucket with the detergent and water
One bucket with just plain water.

Rinse the mit after each panel in the plain water, then dunk it into the detergent water. This helps prevent small grime being dragged across the paint, and to keep your wash water clean for the same reason.