FloodNet Challenge @ EARTHVISION 2021 - Track 1 Forum

Go back to competition Back to thread list Post in this thread

> What's the order of the feedback per-class IoU?

The feedback per-class IoU is a list of float numbers.
What are their corresponding categories?
Thanks!

Posted by: EVER @ March 31, 2021, 3:31 a.m.

IoUs correspond to the following categories sequentially:

Class Index Class Name
0 Background
1 Building-flooded
2 Building-non-flooded
3 Road-flooded
4 Road-non-flooded
5 Water
6 Tree
7 Vehicle
8 Pool
9 Grass

Hope this answers your question.

Posted by: binalab @ March 31, 2021, 4:55 a.m.

If so, my current mIoU is computed over all 10 classes.
But I find that the mIoU reported in your paper is computed over 9 foreground classes.
Such as Table.4, for PSPNet, (68.93+ 89.75+ 82.16+ 91.18+ 92.00+ 89.55+ 46.15+ 64.19+ 93.29)/ 9 ~= 79.68

I suggest that you can make it consistent and align with your paper.

Thanks.

Posted by: EVER @ March 31, 2021, 10:02 a.m.

In the paper we did not consider Background in the calculation of mean IoU, but in the competition IoU of background is included. That's why we have 10 classes to consider to calculate mean IoU in the competition.

Thank you!

Posted by: binalab @ March 31, 2021, 1:48 p.m.
Post in this thread