Behavior blacklisting is a security method based on detecting specified suspicious actions on the part of software or human agents and blocking access accordingly.
Like behavior whitelisting, behavior blacklisting is used to secure email systems against spam and phishing attempts, to protect websites, services and forums from bots and hackers and to safeguard computers from malware and hacking attempts. Breach detection systems (BDS) also rely on behavior blacklisting to maintain network security.
Content-based filtering and IP-based blacklisting, the two most common methods used to block spam, are becoming less effective as spammers have adapted their own techniques to foil them. Blacklisting can catch a significant percentage of spam missed by those methods. In a behavior-based spam filter, instead of a record of IP addresses to be blocked as known offenders, the software tracks behaviors such as sending patterns. Similarly-sent suspected mass mailings are easily blocked. Web crawling bots that may spam or vandalize websites and forums can also be blocked because of their recognizable scripted behaviors. Heuristics-based antivirus systems are essentially a form of behavior blacklisting, helping to detect new threats and especially new variants of existing viruses.
Behavior blacklisting is especially useful on machines that have many required functions and those that are constantly changing; it can take more work to update a whitelist in such variable environments. Nevertheless, the list of allowed software and network behaviors, code executed and email addresses that could be specified on a whitelist is typically shorter than a similar compliation for a blacklist. Blacklisting behavior ensures more unblocked capabilities to begin with but must be kept up to date, and that may require more work in the long run to keep pace with changing IPs, environments and threats.