NIST: Security products need standardization

Despite wide use across government, intrusion detection systems have no standard metrics to measure their performance, according to a new report by the National Institute of Standards and Technology.

The report "An Overview of Issues in Testing Intrusion Detection Systems" concluded that there are no comprehensive and scientifically rigorous methodologies to test the effectiveness of intrusion detection systems, which monitor and analyze systems and network traffic for possible hacker attackers or misuse.

Internet Security Systems Inc., Network Associates Inc. and Symantec Corp. are among the vendors who sell intrusion detection systems.

NIST identified some probable metrics in the June report. They include:

  • Coverage: The range of attacks that a system could detect.

  • False alarms: The rate of false positives generated by a system.

  • Detection rate: The number of attacks a system can detect in a given period of time.

  • Resistance to attacks: The ability of the system to resist attacks to itself.

  • Throughput: How much traffic can the system handle at a given time.

  • Correlation: The ability to synthesize disparate events into a correct recognition of attacks.

  • Detection of novel attacks: The ability of the system to detect attacks that have not occurred before.

  • Detection of attack success: The ability to determine if the attack is successful.

  • The report identified the work needed in each of these areas to develop metrics.

    About the Author

    Joab Jackson is the senior technology editor for Government Computer News.

    Reader Comments

    Please post your comments here. Comments are moderated, so they may not appear immediately after submitting. We will not post comments that we consider abusive or off-topic.

    Please type the letters/numbers you see above

    What is your e-mail address?

    My e-mail address is:

    Do you have a password?

    Forgot your password? Click here


    • Dive into our Contract Award database

      In an exclusive for WT Insider members, we are collecting all of the contract awards we cover into a database that you can sort by contractor, agency, value and other parameters. You can also download it into a spreadsheet. Our databases track awards back to 2013. Read More

    • Navigating the trends and issues of 2016 Nick Wakeman

      In our latest WT Insider Report, we pull together our best advice, insights and reporting on the trends and issues that will shape the market in 2016 and beyond. Read More

    contracts DB

    Washington Technology Daily

    Sign up for our newsletter.

    Terms and Privacy Policy consent

    I agree to this site's Privacy Policy.