Are you low on fuel? The filter is on the end of the fuel pump in the tank or on the fuel line i think on the v6s its in the tank. But ya i think you are headed in the rite direction.

You can take out the fuel pump just take up your trunk carpet and take off the plate covering it. Take your cap off to help relive the fuel tank pressure and pull the fuel pump connector , start your car run it till it dies this gets all the pressure out of the line. Then undo the line you push the two tabs. Now i cant remember if the pump is just bolted on the tank or if it has one big nut holding it on (surrounds the out side of the fuel pump). Thats it pumps out. Take a look at your filter and your fuel pick up line also look into your tank for debre. Reinstating be nice to the gasket if you damage it you will set an evap leak code.

If it runs fine at high rpms your fuel pressure is probably fine.