Adversarial VQA is a new VQA benchmark that is collected with Human-And-Model-in-the-Loop for evaluating the robustness of state-of-the-art VQA systems.
Details on downloading the latest dataset may be found on the download webpage.
August 2021: Full release (v1.0)