Competition

Evaluation Criteria

The semantic labelling performance is assessed based on the standard Jaccard Index, more known as the PASCAL VOC intersection-over-union metric.

IoU = TP /(TP+FP+FN).

TP, FP and FN are the numbers of true positive, false positive and false negative respectively, which can be calculated through the confusion matrix determined over all data from test split.
The goal for this task is to achieve as high IoU score as possible. For UAVid dataset, clutter class has a relatively large pixel number ratio and consists of meaningful objects, which is taken as one class for both training and evaluation rather than being ignored.

Semantic Labelling Task

The task for UAVid dataset is to predict per-pixel semantic labelling for the UAV video sequences. The original video file for each sequence is provided together with the labelled images. Currently, UAVid only supports image level semantic labelling without instance level consideration.

Terms and Conditions

Researcher hereby agrees to the following terms and conditions:

1. Researcher shall use the Database only for non-commercial research and educational purposes.
2. Researcher may provide research associates and colleagues with access to the Database provided that they first agree to be bound by these terms and conditions.