Building Better Maps for a Better World and You Could Win $10,000!!!!
At Telenav, we've always been about making people's lives less stressful, more productive, and more fun when they are on the go. Over the years, we've paved the way for building the necessary tools to help transform the way mapmaking occurs—more recently with the launch of our mobile mapping application, OpenStreetCam. To date, drivers all over the world have contributed more than 130 million street images from which we've been able to detect automatically many road features.
In order to continue to support this transformation, we're now open-sourcing through this contest two key components of our machine-learning technology aimed at detecting navigation features in street-level imagery:
With this contest, we are looking for your support to help enhance both the training sets and the detection nets and ensure that the next era of mapmaking remains open and accessible to everyone.
The evaluation is based on measuring the accuracy between the predicted bounding boxes and the ground-truth bounding boxes with the following formula:
accuracy = tp / (tp + fp + fn - nr_misclass)
For computing the final accuracy score, we only use the ground-truth bounding boxes which have both the width and the height greater than 25 pixels.
A prediction is considered correct if it has an IoU (intersection over union) greater than 0.25 and has the same sign category as the ground-truth bounding box. For more details regarding the IoU, check this.
Model accuracy: Prize money will be awarded only if the score from the leaderboard is bigger or equal to 94%.
Performance rule: The image processing time should not be higher than 0.5 seconds per GPU (for Nvidia 1080Ti).
Submissions may not use or incorporate information from hand labeling or human prediction of the validation dataset or test data records.
Clarifications regarding NR_MISCLASS
In the situation when you accurately detected the location of the bounding boxes but you predicted another sign category (you misclassified the sign), we don't want to add both an FP (your sign) and an FN (the ground-truth sign) to the metrics when computing the accuracy. As a result, we use the NR_MISCLASS to deal with this situation and add only +1 penalty and not +2.
Breach of any contest rule specified below is ground for disqualification. In the event of any dispute in connection with the contest or with the interpretation or implementation of these rules, the decision of the organizers shall be final.
1 Training Sets
The training sets in this dataset belong to Telenav, Inc. (“Telenav”) and are licensed under a Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) License.
The Telenav source code is subject to the terms of the Mozilla Public License, v. 2.0. A copy of the MPL can be found at http://mozilla.org/MPL/2.0/.
The contest is open to everyone above the age of eighteen (18) and is void where prohibited by law.
4 Specific rules:
By entering this contest, you agree:
(a) To abide by these official rules;
(b) To the extent allowable under applicable law, to release and hold harmless Telenav and sponsors, their respective parents, subsidiaries, affiliates, employees and agents from any and all liability or any injury, loss, damage, right, claim or action of any kind arising from or in connection with this contest or any prize won;
(c) That Telenav’s decisions will be final and binding on all matters related to this contest; and
(d) That by accepting a prize, Telenav and competition sponsors may use your team name, your name, and your place of residence online and in print, or in any other media, in connection with this contest, without payment or compensation to you. The declaration of eligibility, use, indemnity and liability/publicity release provided to the potential winner will make reference to obtaining his/her free consent to use his/her name and place of residence. In any case, the lack of such consent does not prevent the winner from receiving the prize.
(e) This contest will be governed by the laws of the state of California, and you consent to the exclusive jurisdiction and venue of the courts of the state of California for any disputes arising out of this contest.
Start: May 15, 2018, midnight
Aug. 17, 2018, midnight
You must be logged in to participate in competitions.Sign In