Remember, when the clutch engages (Ac on), the compressor shaft in side is turning, and the compressor is pumping. Additionally, the pulley bearing is not turning since the clutch is "clamped".

With AC off, the pulley is still turning on it's bearing, and the clutch is not "clamped".