choppyness and drop in power is the main indicator that your turbo is just running out of life at that point. Post a picture of your manifold. Ive seen some REALLY ****ty manifolds make a lot more power than you are making. 2.5" downpipe should be perfectly fine for what you are trying to do, there has been 400hp cars running 2.5" downpipes.