Rough is in the seat of the rider. Everyone feels different as to how what feels. In general a lower car will ride rougher.
Personally I feel that unless you are racing on a track the lower ride is not worth the penalties. With the right tires, shocks, and sway bars, and good bushings you can greatly improve the handling without seriously affecting the ride and you still have full suspension travel to take the bumps that are found in street driving that a track car simply does not have the suspension to deal with.

Hope this helps.