So2Sat Multimodal Image Classification Baseline Evaluation
Results obtained using Armory v0.13.3
| Attacked Modality | Patch Ratio | Benign Accuracy (Undefended) | Adversarial Accuracy (Undefended) | Benign Accuracy (Defended) | Adversarial Accuracy (Defended) | Test Size |
|---|---|---|---|---|---|---|
| EO | 0.05 | 0.583 | 0.00 | 0.556 | 0.00 | 1000 |
| EO | 0.10 | 0.583 | 0.00 | 0.556 | 0.00 | 1000 |
| EO | 0.15 | 0.583 | 0.00 | 0.556 | 0.00 | 1000 |
| SAR | 0.05 | 0.583 | 0.00 | 0.556 | 0.00 | 1000 |
| SAR | 0.10 | 0.583 | 0.00 | 0.556 | 0.00 | 1000 |
| SAR | 0.15 | 0.583 | 0.00 | 0.556 | 0.00 | 1000 |
Find reference baseline configurations here