the thing is not really to do with the fact that he used a derogatory term for black people, but the intent of his use. from context you could clearly notice that he did feel contempt and had ignorant prejudice towards black people.
i swear and used derogatory terms every now and then, and i know it's not good, but i've never used it in a manner to actually offend someone of a certain race.