If you consider him a good friend, you should go.

Otherwise, he should stop being a douche and respect your reasons for not being able to go.