spray wd40 on the belt one at a time. if the noise disappears, then thats the culprit.
dont spray a lot though.