Getting a smaller refund has nothing to do with how good your job is. It depends on how much more or less than your total tax liability for the year is withheld from your checks.

Two people can make the exact same amount and one get back $20 and one get back $2000... it all depends on how much is withheld.