i dont know how big you are & i dont know how big he is..

but i'd say just go ahead & fight the stupid bastard & get it out of the way..

the worst that will happen is you getting your ass kicked.