Stealth mode for the OS X firewall

In the firewall advanced preferences, you can enable the feature called "Enable Stealth Mode". This will ensure that traffic that you didn't allow won't receive a response, not even an acknowledgment.