Pull the code, find out what it is, and go from there... Your probably right, it could be the O2 sensor...
To pull the code, lift the pass side carpet, and turn the key on (not all the way to start the car), and look at the ECU theres a small hole there with a blinking LED, count the number of blinks...