Dude, I wouldn't worry about it too much. He may just have been lost. He could have been calling someone for directions and just as your boss came by, he left to get somewhere on time since he was probably lost already. If your really that worried, just park somewhere that you can see your car at all times or where you can't see your car from the street.