You're talking about the run channel. It's a big rubber seal that starts at the front bottom of the window, wraps all the way around the door, then back down into the door on the window's back side. If opening the door panel and removing the glass doesn't scare you, it's a peice of cake.
Make sure the regulator is good, if it isn't now is the best time to replace it.