Had you not known, there would be no reason to feel bad for saying it. However, you'd been told and are now an asshole.