Task 1A

The tables report the results for task 1A considering the results achieved by each team. The Annealing time measures the execution time of the approach. In the case of Quantum Annealing this consists in the programming time, sampling time and post-processing time. We will conduct a deeper analysis comparing the SA vs QA/Hybrid approaches used and we will run our baseline according to the number of features chosen by the participants' approaches to consider a more fair comparison.

MQ2007
BIT.UA 1A_MQ2007_QA_BIT.UA_0 0.441 273682 Q 18
BIT.UA 1A_MQ2007_QA_BIT.UA_1 0.4497 269805 Q 20
BIT.UA 1A_MQ2007_SA_BIT.UA_0 0.441 1351082 S 16
BIT.UA 1A_MQ2007_SA_BIT.UA_1 0.4446 3606880 S 18
NICA 1A_MQ2007_QA_NICA_6f7d7d44-c559-4e36-9b10-b7e51e521036 0.4506 274119 Q 17
NICA 1A_MQ2007_SA_NICA_SA-169 0.4498 3509658 S 15
OWS 1A_MQ2007_QA_ows_1-mi-bootstrap-mixture 0.4495 279003 Q 25
OWS 1A_MQ2007_QA_ows_1-mi-linear-and-quadratic-bootstrapped-boost-3 0.4506 270403 Q 25
OWS 1A_MQ2007_QA_ows_1-mi-linear-bootstrapped-boost-3 0.448 240682 Q 25
OWS 1A_MQ2007_SA_ows_1-mi-bootstrap-mixture 0.4475 2817661 S 25
OWS 1A_MQ2007_SA_ows_1-mi-linear-and-quadratic-bootstrapped-boost-3 0.4519 2752363 S 25
OWS 1A_MQ2007_SA_ows_1-mi-linear-bootstrapped-boost-3 0.4515 2758836 S 25
QTB 1A_MQ2007_QA_qtb_NT1 0.4299 356041 Q 13
QTB 1A_MQ2007_QA_qtb_NT2 0.4195 5000000 H 10
QTB 1A_MQ2007_QA_qtb_NT3 0.443 4309227 H 10
QTB 1A_MQ2007_SA_qtb_NT1 0.4024 3174123 S 10
shm2024 1A_MQ2007_QA _shm2024_b059646f-a9fd-4fd6-9589-c6e117400a9e 0.365 29600 Q 5
shm2024 1A_MQ2007_QA _shm2024_cabcc142-3fc5-4b22-8a6b-c7a45857fbc2 0.3621 27222 Q 5
shm2024 1A_MQ2007_QA _shm2024_f6c1c464-6dba-4a44-93b8-92ad6c4f60f9 0.391 29414 Q 5
shm2024 1A_MQ2007_QA _shm2024_853286a3-7f47-4de8-b0a0-247a65e6f6b6 0.3477 28254 Q 5
shm2024 1A_MQ2007_QA _shm2024_824484f0-b6fa-44b6-9bc7-0cb073db84e7 0.3245 29315 Q 5
shm2024 1A_MQ2007_SA _shm2024_SA-521 0.4024 284106 S 5
shm2024 1A_MQ2007_SA _shm2024_SA-560 0.3082 163964 S 5
shm2024 1A_MQ2007_SA _shm2024_SA-620 0.4249 143183 S 5
shm2024 1A_MQ2007_SA _shm2024_SA-623 0.4248 146676 S 5
shm2024 1A_MQ2007_SA _shm2024_SA-625 0.4205 144050 S 5
Baseline ALL_FEATURES 0.4473 - - 46
Baseline AUTO_SELECTION 0.4450 - - 23

ISTELLA
BIT.UA 1A_ISTELLA_QA_BIT.UA_3 0.6699 16324680 S+Q 92
BIT.UA 1A_ISTELLA_QA_BIT.UA_4 0.6905 551363 Q 82
BIT.UA 1A_ISTELLA_SA_BIT.UA_3 0.6814 19071071 S 90
BIT.UA 1A_ISTELLA_SA_BIT.UA_4 0.7029 5403909 S 72
BIT.UA 1A_ISTELLA_SA_BIT.UA_2 0.7081 13827390 S 161
NICA 1A_ISTELLA_QA_NICA_c5888bf1-4549-418c-92b8-b7175c9185e4 0.596 427442 Q 15
NICA 1A_ISTELLA_SA_NICA_SA-380 0.6211 3998441 S 15
OWS 1A_ISTELLA_QA_ows_1-mi-bootstrap-mixture 0.6207 215162 Q 25
OWS 1A_ISTELLA_QA_ows_1-mi-linear-and-quadratic-bootstrapped-boost-3 0.609 393601 Q 25
OWS 1A_ISTELLA_QA_ows_1-mi-linear-bootstrapped-boost-3 0.6317 402041 Q 25
OWS 1A_ISTELLA_SA_ows_1-mi-bootstrap-mixture 0.6566 3874706 S 25
OWS 1A_ISTELLA_SA_ows_1-mi-linear-and-quadratic-bootstrapped-boost-3 0.6541 3727877 S 25
OWS 1A_ISTELLA_SA_ows_1-mi-linear-bootstrapped-boost-3 0.6088 3784835 S 25
Baseline ALL_FEATURES 0.7146 - - 220
Baseline HALF_FEATURES 0.5560 - - 110

Task 1B

The tables report the results for task 1B considering the results achieved by each team. The Annealing time measures the execution time of the approach. In the case of Quantum Annealing this consists in the programming time, sampling time and post-processing time. We will conduct a deeper analysis comparing the SA vs QA/Hybrid approaches used and we will run our baseline according to the number of features chosen by the participants' approaches to consider a more fair comparison.

ICM_150
CRUISE 1B_150_ICM_QA_CRUISE_1 0.0805 536250 Q 138
CRUISE 1B_150_ICM_QA_CRUISE_2 0.0826 528844 Q 136
CRUISE 1B_150_ICM_QA_CRUISE_3 0.0690 530804 Q 132
CRUISE 1B_150_ICM_QA_CRUISE_4 0.0763 558321 Q 133
CRUISE 1B_150_ICM_QA_CRUISE_5 0.1003 1375068 Q 144
CRUISE 1B_150_ICM_SA_CRUISE_1 0.0998 1745487 S 140
CRUISE 1B_150_ICM_SA_CRUISE_2 0.0993 17357899 S 140
CRUISE 1B_150_ICM_SA_CRUISE_3 0.1001 1760252 S 140
CRUISE 1B_150_ICM_SA_CRUISE_4 0.0793 17387227 S 140
CRUISE 1B_150_ICM_SA_CRUISE_5 0.1003 88395437 S 144
NICA 1B_150_ICM_SA_NICA_SA-457 0.0895 12247027 S 145
BASELINE ALL_FEATURES 0.0810 - - 150

ICM_500
CRUISE 1B_500_ICM_QA_CRUISE_1 0.0757 2287019 Q 407
CRUISE 1B_500_ICM_QA_CRUISE_2 0.0839 2122701 Q 397
CRUISE 1B_500_ICM_SA_CRUISE_1 0.1196 43339285 S 450
CRUISE 1B_500_ICM_SA_CRUISE_2 0.1198 42776695 S 450
BASELINE ALL_FEATURES 0.0827 - - 500

Task 2

The table report the results for task 2 considering the results achieved by each team. The Annealing time measures the execution time of the approach. In the case of Quantum Annealing this consists in the programming time, sampling time and post-processing time.

10 qIIMAS 10_QA_qIIMAS_e1b01739-cc56-4034-baa2-558a44e0bd65 0.5682 6.312144661 14993382 H
10 qIIMAS 10_SA_qIIMAS_SA-127 0.5622 6.684709428 535515590 S
10 BASELINE BASELINE 0.5509 7.989243805 - -
25 qIIMAS 25_QA_qIIMAS_03bebd51-40ad-4d45-b2a1-8d58b829afc6 0.549 5.350996482 14994603 H
25 qIIMAS 25_SA_qIIMAS_SA-128 0.546 5.336858911 565985460 S
25 BASELINE BASELINE 0.5284 6.120091289 - -
50 qIIMAS 50_QA_qIIMAS_3ab55ef5-02e9-4c4d-9c7c-51cb56be3d9a 0.518 5.184247242 18492 Q
50 qIIMAS 50_QA_qIIMAS_5dea3549-a264-4f70-812a-ac52b2108663 0.5349 4.697829204 66678 Q
50 qIIMAS 50_QA_qIIMAS_5fea759c-377b-4dab-80d8-ca70ba205f02 0.5274 4.953743721 29995388 H
50 qIIMAS 50_QA_qIIMAS_4149b16f-88b7-4c90-b9cd-7bec94929898 0.5564 4.803179136 14992727 H
50 qIIMAS 50_QA_qIIMAS_d05e1280-3b04-4897-aa0f-5d508d72d8e0 0.5011 5.086784699 3993683 H
50 qIIMAS 50_SA_qIIMAS_SA-129 0.5068 4.786837347 610067830 S
50 qIIMAS 50_SA_qIIMAS_SA-341 0.5065 5.415931254 2792784 S
50 qIIMAS 50_SA_qIIMAS_SA-343 0.531 4.811210971 2870845 S
50 BASELINE BASELINE 0.4656 5.367918023 - -