it's worse to ride the clutch.
There are certain speeds that you should downshift at in accordance with their respective gears. Clutches wear out so plan on dropping the cash for a new one sometime down the road.
You shouldn't downshift into first, or downshift harder than you would rev the engine up.
if you want to downshift and keep rolling in that gear then yes ease it into gear using the throttle to make it smooth and let off or get on it as much as needed.