I was reading on the 7thgen civic forum, and it looks like the knocking problem is common on civic 01-06. And they also said to re-check to see if the springs is still in place, it's maybe not sitting correctly on top.
Forum Rules