My car does this too. Typically what happens is when you lift off throttle your fuel injectors shut off until RPM drops, before the PCM turns the injectors back on as RPM falls towards idle. When the injectors come back on, a little unburnt fuel might get into the hot exhaust and combust. That's what gives you the pop.

Also an exhaust leak sometimes can cause pops off throttle.