if needle nos epliers, a screwdriver, and a pick do not work, then yes, you have to buy a new fuse block.

or, you can wire the fuel pump fuse in separate from the fuse block with a fuse holder.

there are plenty of open spots on the fuse block that supply power only with the key on... use one of those next time.