So I tightened up the headers completely and it looks like it might just be the positioning of the headers when they were welded. They clear the pan on the top, but they are really close to the tall side of the oil pan, not quite touching, but almost ball hair clearance.