HR people can have some massive pull. In all cases, they'll take his word over yours, so this is something you'll have to put up with during the day and hope to catch this guy outside of the office.