Your word against his, and you will more than likely lose.

That's just how the system is. It sucks.

And it's a moving violation, so 3 points and it does go on your insurance for 3 years.