The temperature knob runs a cable attached to air damper doors, and ultimately to a water valve on a heater hose. Maybe a cable is broken or disconnected? Then the REAL problem is your heater is on all the time.