SEED-Bench

Results

Zero-shot Results of Kosmos-2 on SEED-Bench are shown here

Data preparation

1. Download image and annotations follow official instruction.
2. Run kosmos-2/evaluation/seed-bench/cook_image_data.py to convert the data format (Image task only now).
3. Run the following command to eval:

cd unilm/kosmos-2

bash evaluation/zeroshot-seed-bench.sh 0 32 /path/to/kosmos-2.pt /path/to/seed-bench/converted-data