They are allowed to pace you to get the speed at which you're traveling.

It will ultimately come down to your word against his if you try to fight it and take it to trial. Whose do you think they'll believe?

Best bet is to negotiate with the solicitor and ask for it to be reduced so it doesn't get reported to insurance or points on your license.