Pull the pole then remove it when you get home. Careful though, some of those sign poles and buried deep.
That and some of them have concrete to hold them in the ground. I would say that its best to just unbolt it from the post... like Ran said, they are buried REALLY deep and you don't want to have to dig to get it out.