all you have to do to get the silencer off is just let the engine run for a little bit till the exhaust gets hot and it should expand, allowing you to get the silencer out with less frustration.

edit: im not saying that its going to come right out, it will still take some yankage.