ROADEF'2009 Challenge Results

The following table presents the final ranking obtained using the average normalized score, computed as follows. Let z(M,I) denote the objective function value obtained by Method M on Instance I. Let zb(I) and zw(I) denote the best and worst objective function values found on instance I, respectively. The normalized score obtained by Method M on Instance I is given by (zw(I)-z(M,I))/(zw(I)-zb(I)). If a method does not provide a solution or if the returned solution is infeasible, its score is set to two times zw(I). The average score is computed using instances B01,…,B10 and instances XA1,…,XB4 (see tables below). The qualified teams that did not send any program for the final phase where not ranked. The winners of categories Senior and Junior are displayed in bold. Congratulations to them!

Team Category Global rank (category rank) Average score (%)
Bisaillon, Cordeau, Laporte, Pasin Senior 1(1) 95,90
Hanafi, Wilbaut, Mansi, Clautiaux Senior 2(2) 92,73
Acuna-Agost, Michelon, Feillet, Gueye Senior 3(3) 74,26
Eggermont, Firat, Hurkens, Modelski Junior 4(1) 72,01
Darlay, Kronek, Schrenk, Zaourar Junior 5(2) 70,62
Peekstok, Kuipers Senior 6(4) 70,31
Jozefowiez, Mancel, Mora-Camino Senior 7(5) 64,02
Dickson, Smith, Li Junior 8(3) 42,02
Eggenberg, Salani Junior 9(4) 20,48

The table below presents detailed results on "B" instances, giving for each instance the obtained objective value. The best solution is displayed in bold. INF means that the solution is infeasible of that no solution has been returned in 600 seconds. In this case the obtained score is indicated in row INF.

Equipe B01 B02 B03 B04 B05 B06 B07 B08 B09 B10
Bisaillon, Cordeau, Laporte, Pasin 983731,75 1522452.75 1031825.30 1192519.20 15639190.80 3789254.05 5488693.00 4069557.35 5906239.15 52355192.80
Hanafi, Wilbaut, Mansi, Clautiaux 5813896.95 9950888.70 5569623.95 5775277.70 13139974.30 9095248.10 19144460.30 10099607.00 10176173.55 34523605.00
Acuna-Agost, Michelon, Feillet, Gueye 1540123.55 2656393.25 1572754.95 1629491.90 14042563.85 4926204.05 8381142.30 5092952.60 5414178.30 40080949.40
Eggermont, Firat, Hurkens, Modelski 3217796.25 4461933.95 3271881.70 3543256.85 31672882.38 8551295.95 13986055.45 8497737.40 9801201.70 79360538.12
Darlay, Kronek, Schrenk, Zaourar 2536224.55 6606995.30 2608230.65 2579266.05 23851090.70 9464384.25 15325407.75 9116067.25 11028794.15 52379928.90
Peekstok, Kuipers 1590791.95 2482349.85 1650348.50 1667929.00 9653780.05 5993131.95 8580429.20 6234247.00 5465108.55 38537692.15
Jozefowiez, Mancel, Mora-Camino 971182.50 1220708.30 1007565.70 1101394.80 25302036.95 3218000.10 5039744.20 3509318.00 3967344.70 59289841.80
Dickson, Smith, Li 9963882.35 15710470.60 9972001.35 9740290.50 50600941.50 19611307.00 28392630.90 17341482.60 20636676.85 77266518.80
Eggenberg, Salani 43169547.75 INF 47509155.15 46400734.65 94278109.15 66101253.95 INF 62391786.00 68668311.00 124900519.50
INF - 31420941.20 - -- - 56785261.80 - - -
The table below presents detailed results on "X" instances, which remained unknown for all participants until the end of the challenge. Instances XA01 to XA04 are similar to "A" instances while instances XB01 to XB04 are similar to "B" instances. Instances X01 to X04 are large instances that were not included in the evaluation set.
Equipe XA01 XA02 XA03 XA04 XB01 XB02 XB03 XB04 X01 X02 X03 X04
Bisaillon, Cordeau, Laporte, Pasin 462571.10 2238311.75 959080.90 5480962.75 1352823.05 17064421.50 6463354.30 53543381.45 1116142.85 806011.20 2682125.00 485904.75
Hanafi, Wilbaut, Mansi, Clautiaux 116195.20 1475322.10 285287.05 4112262.60 5985772.05 12716512.00 11124244.55 34331225.80 INF INF INF INF
Acuna-Agost, Michelon, Feillet, Gueye 214321.95 2010576.25 433172.00 6575537.15 INF INF INF INF INF INF INF INF
Eggermont, Firat, Hurkens, Modelski 668551.40 5046206.95 1296361.80 6968582.90 3435588.65 INF INF INF INF INF INF INF
Darlay, Kronek, Schrenk, Zaourar 264756.30 INF 604065.45 INF 3300123.35 23798066.00 INF INF INF INF INF INF
Peekstok, Kuipers 145591.00 2614075.45 INF INFINF 11297822.20 INF INF INF INF INF INF
Jozefowiez, Mancel, Mora-Camino 150857.60 INF 404964.20 INFINF INF INF INF INF INF INF INF
Dickson, Smith, Li INF INF INF INFINF 48707651.85 INF INF INF INF INF INF
Eggenberg, Salani 3743311.35 19156807.65 5046151.00 INF52947166.05 100140971.75 67931981.80 120051351.40 INF INF INF INF
INF 7486622.70 38313615.30 10092302.00 13937165.80 105894332.10 200281943.50 135863963.60 240102702.80 2232285.70 1612022.40 5364250.00 971809.50