DARPA Open Sources Resources to Aid Evaluation of Adversarial AI Defenses

• auto-attack

  3 608 0.0 Python

  Code relative to "Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks"

I'm less familiar with poisoning, but at least for test-time robustness, the current benchmark for image classifiers is AutoAttack [0,1]. It's an ensemble of adaptive & parameter-free gradient-based and black-box attacks. Submitted academic work is typically considered incomplete without an evaluation on AA (and sometimes deepfool [2]). It is good to see that both are included in ART.

[0] https://arxiv.org/abs/2003.01690

[1] https://github.com/fra31/auto-attack

[2] https://arxiv.org/abs/1511.04599

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project