Can I clarify how the EVM score is computed, and why our code got a 0 EVM score even though the predictions are all correct (leading to an overall score of 40)?
Thanks!
Posted by: adithya005 @ May 4, 2021, 3:44 a.m.Hi,
the three signals that are evaluated on CodaLab all have a 'best achievable' EVM. This is the EVM the VSE would measure when all signal parameters are set correctly. For this EVM result you would get 10 pts. For all other results, 1 point is deducted per dB deviation to a minimum of 0 pts (as described in the challenge description).
I just checked your submission previous to your forum post and you scored 40 pts. Checking the logs it looks like this submission (try6.zip) got all parameters of signal 1 correct and also scored 10 pts for the EVM. Sometimes it can happen that even though your parameter predictions are wrong, you would get a good score for the EVM (can you figure out why?). However, if all parameters are estimated correctly, you would also get the full 10 pts for EVM (if this is not the case, please contact us via mail and we will check the submission again).