I've done it many times. There's plenty of roads around here that are so 'out there' that if you get behind someone going slow. Anyone around here will pass em. Double lines, passing lines, or even on roads that don't have any lines.

I believe there are situations where it's not black and white.