Saying that in front of anyone that is Chinese is offensive, unless they are really cool with you. I have a co-worker that makes jokes like that to me all the time, difference is, we know we're joking.
It's amazing how people get all butthurt when the n bomb is dropped, but when Asian derogatory words are used, it's harmless.