If I wasn't building full boost, I'd look for a boost leak, which you already seemed to have pointed out.