It’s the buttons, I didn’t notice that there was a red light on the remote that when the signal is sent lights up (it's my wifes car and I rarely drive it). I took both remotes a-part thinking if I blew the switches out with air they may work. I had no luck but if I push the buttons down and to the side they work most of the time. I guess I will be getting two new remotes.

Thanks for the help cruzalekz.