Competition

Process Discovery Algorithm Challenge 2020

Organized by Alexey - Current server time: Jan. 18, 2021, 7:36 a.m. UTC

First phase

Development
Oct. 12, 2020, 6 a.m. UTC

End

Competition Ends
Nov. 13, 2020, 8:59 p.m. UTC

Process Discovery Algorithm Challenge 2020

Participants should implement Heuristic Miner Algorithm.

All questions with regard to the challenge are discussed on the official Forum.

Evaluation

Evaluation is based on the following criteria:

  • equality to reference implementation made by pm4py - [0.0, 1.0]
  • performance - average duration of algorithm work on public\private logs
  • code quality by pylint normalized to [0.0, 1.0]

Leaderboard sudmissions are ranked by all three criteria with abovementioned ordering.

Submission to the competition involves uploading a .zip archive containing (see starting kit for sample submission):

  • metadata - empty file due to codalab requirements
  • miner.py - script with heuristic miner implementation algorithm

Starting kit contains sample submission.

Submission is run in docker container naydyonov/pm4py:version-1.5.2.2

All questions with regard to the challenge are discussed on the official Forum.

Rules

MIT licence is obligatory for code submited by participants.

Winner will receive a small token of appreciation.

All questions with regard to the challenge are discussed on the official Forum.

Starting Kit

Starting kit equips you with some template data and code compatible with the competition rules. We highly recommend reviewing the starting kit to elucidate the obscurities of code implementation or scoring procedure.

The starting kit comprises the folders:

  • sample_data. Here a log file resides for algorithm development purposes.
  • sample_reference. Example of heuristic net build by pm4py heuristic miner implementation over sample data.
  • sample_code_submission. Template for algorithm implementation. The task is to implement heuristic miner algorithm inside 'apply_hue_miner' function in 'sample_submission/miner.py' file.
  • ingestion. Here is the script which runs a code submitted. The script takes log file from sample data and puts the results into sample_result_submission.
  • scoring. A script which evaluates code submitted. We use exactly the same script for evaluation on private data. As you’re allowed to submit only a few times a day, it’s useful to have evaluation routine of your own.

Submission is run in docker container naydyonov/pm4py:version-1.5.2.2, so take in account please environment requirements.

The task is to implement heuristic miner algorithm inside 'apply_hue_miner' function in 'sample_submission/miner.py' file.

All questions with regard to the challenge are discussed on the official Forum.

# User Graph Identity Duration PyLint Score
1 VitaLeeY 1 0,6525 0,87
2 danilov-as 0,8929 0,3002 0,98
3 skvkatie 0,8929 0,6505 0,94
4 shevaruten 0,8929 0,6933 0,94
5 vadim2011 0,85 1,7447 0,58
6 B-tum 0,85 28,1053 0,66
7 ValentinaFedorova 0,85 96,5854 0,5
8 Igor_KA 0,7946 7,899 0,8
9 baveo0811 0,7 0,4805 0,05
10 KIB 0,7 1,4775 0,51
11 Knishenko_Anastasia 0,6786 3,042 0,99
12 Shadiyan_Makar 0,625 2,7718 0,99
13 Popova_L 0,6071 3,0501 0,82
14 Sur_Daniil 0,5962 3,1166 0,97
15 Golubeva 0,5831 1,1349 0,58
16 OoMini 0,571 16,7498 0,63
17 Margo-mvf 0,5433 4,291 0,25
18 DAMaxim 0,5433 5,5351 0,25
19 Usachev_Dmitry 0,5185 3,1151 0,38
20 iov-rv-bb 0,5183 82,0769 0,36
21 aikimind 0,5 60,4671 0,88
22 anatoliy26 0,4557 9,3126 0,15
23 Natalex 0,454 11,7743 0,27
24 DDaria 0,454 11,8161 0,27
25 Natalia_Yur 0,454 14,6968 0,31
26 TatyanaE 0,454 15,7166 0,31
27 Evgenia 0,454 16,7709 0,31
28 Sudarev_Vladimir 0,4524 19,582 0,28
29 Anna-P 0,4007 9,0054 0,65
30 Alexander_Balandin 0,4007 13,4199 0,65
31 geraskova_antonina 0,3341 53,9605 0,71
32 vehnep 0,2893 3,2527 0,5
33 John_Doe 0,2893 3,8308 0,5
34 latticetower 0,2755 111,8559 0,5
35 hello_linux 0,25 3,6857 0,67
36 gavrikov.i 0,25 6,3531 0,48
37 Amitater 0,25 6,556 0,48
38 Dmitrii_Khodaev 0,25 8,2129 0,48
39 NikitaU 0,25 8,6338 0,48
40 Stepanova-AI 0,0119 0 0,04
41 IRVarakin 0,0119 0,003 0,62
42 ArtamonovRS 0 0 0,11
43 Sophia_Ion 0 0 0,11
44 Galina0805 0 0 0,11
45 UBA_UB_IVAN 0 0 0,11
46 Alexey_ 0 0 0,11
47 vitkovay 0 0 0,11
48 Milovanov-MV 0 0 0,11
49 Mikhailov 0 0 0,11
50 DmitriySamus 0 0 0,11
51 e.tsynskiy 0 0 0,11
52 MiKonstantin 0 0 0,11
53 EgorSavkin 0 0 0,11
54 Alex_s 0 0 0,11
55 andrsl 0 0 0,11
56 Litvinov_dmitriy 0 0 0,11
57 Belov_SV 0 0 0,11
58 Mityunina_Natasha 0 0 0,11
59 Bagdasaryan_Dmitry 0 0 0,11
60 Romanov_Alexandr 0 0 0,11
61 Angalina 0 0 0,11
62 Mushkudiani_Roman 0 0 0,11
63 Banakh_Rostislav 0 0 0,11
64 Zagrebelny_Alexander 0 0 0,11
65 Mikhalev_Stepan 0 0 0,11
66 andrey_mak 0 0 0,11
67 Andrei 0 0 0,11
68 Darmorezov_Vadim 0 0 0,11
69 alex61r 0 0 0,11
70 _Konstantin_ 0 0 0,11
71 Dadikm 0 0 0,11
72 Igumnov-YG 0 0 0,11
73 SergeyVM 0 0 0,11
74 IlyaMossur 0 0 0,11
75 IldarVS 0 0 0,11
76 A_A_Rudenko 0 0 0,11
77 tsykin-aa 0 0 0,11
78 alexpetrov 0 0 0,11
79 pasha0708 0 0 0,11
80 Sergey_rsa 0 0 0,11
81 Puzankov 0 0 0,11
82 vladsmnv 0 0 0,11
83 AVF1311 0 0 0,11
84 slava43212 0 0 0,11
85 gganastasiya 0 0 0,11
86 annetalllll 0 0 0,11
87 nna 0 0 0,11
88 YasinetsM 0 0 0,11
89 Evengy 0 0 0,11

Development

Start: Oct. 12, 2020, 6 a.m.

Description: Development phase: implement algorithm on public logs.

Evaluation

Start: Nov. 1, 2020, 8:59 p.m.

Description: Test phase: evaluation on private logs.

Competition Ends

Nov. 13, 2020, 8:59 p.m.

You must be logged in to participate in competitions.

Sign In