No, they both do both.

People associate the term "torque" with low rpm. A motor can make a lot of torque at high rpm and be really crappy off the line.

Torque is force, horsepower is a calculation based on force and rpm.

So to modify your colloquialism, "low rpm torque gets you moving, high rpm horsepower keeps you moving."