There is a set screw there. It might be hard to see with the internal black plastic cover. Just make sure you don't strip it when trying to remove it.