From what I've heard, people use the largest rim necessary solely for the purpose of clearing brakes. Even when you go to a larger rim of the same weight, the increased rolling diameter still requires more torque to spin compared to a smaller rim.

I'm no expert in this, so i'll let someone explain the details