Battle of the Crowns -- calibration results so far

[Dann Corbit]

Geschrieben von: / Posted by: Dann Corbit at 30 May 2000 21:13:22:
Note that some programs don't have a lot of games yet. Also, that ExChess and InmiChess got a bunch of easy points by playing a large number of games against a much weaker opponent. I will delay the actual contest as long as necessary -- which will be when the uncertainty figures for both +/- are less than 100 points for each program entered. ExChess_314c is going to be used instead of ExCh314w, and Sjeng_72 will be used rather than Sjeng_71c. I have played extensive side matches to validate which is stronger of these pairs. There is a new version of Noonian which will hopefully work with the latest version of Winboard.
Program Elo + - Games Score Av.Op. Draws
1 Crafty_17_10c : 2782 40 135 121 87.2 % 2449 10.7 %
2 SOS : 2691 66 110 65 71.5 % 2531 13.8 %
3 gromit3 : 2618 69 85 75 62.0 % 2533 14.7 %
4 Comet_B21 : 2600 38 53 210 66.2 % 2483 18.1 %
5 LGoliath_27 : 2589 106 118 36 47.2 % 2608 16.7 %
6 AnMon_506 : 2484 60 74 96 62.5 % 2396 16.7 %
7 Amy_07f : 2475 38 80 171 74.9 % 2285 10.5 %
8 TCBishop_0045 : 2455 99 100 42 41.7 % 2514 21.4 %
9 ExChess_314c : 2452 28 103 241 86.1 % 2136 8.7 %
10 InmiChess_303 : 2449 67 67 93 56.5 % 2404 18.3 %
11 GnuChess_50 : 2436 145 145 22 50.0 % 2436 18.2 %
12 Phalanx_22c : 2428 255 228 10 60.0 % 2358 20.0 %
13 GNUChess_414 : 2417 206 141 18 25.0 % 2608 16.7 %
14 ExCh314w : 2402 353 476 6 41.7 % 2461 16.7 %
15 Arasan_53 : 2389 53 46 167 51.8 % 2376 19.8 %
16 Ant_416 : 2387 40 51 203 63.5 % 2290 17.7 %
17 ZChess_120 : 2382 41 59 180 66.1 % 2266 15.6 %
18 Bringer_16 : 2350 49 52 158 58.9 % 2287 20.3 %
19 Dragon_311-2 : 2325 214 50 75 8.7 % 2734 6.7 %
20 Cilian_413 : 2230 65 45 144 32.6 % 2356 18.1 %
21 Knightx_153 : 2228 364 273 8 18.8 % 2483 12.5 %
22 lambChop_710 : 2226 287 203 10 10.0 % 2608 20.0 %
23 Sjeng_72 : 2219 196 173 16 37.5 % 2308 12.5 %
24 SSEchess_202 : 2165 97 56 83 25.9 % 2347 18.1 %
25 LDBlanche_20c : 2163 153 86 36 20.8 % 2395 19.4 %
26 Amyan_101 : 2127 44 52 206 55.8 % 2086 4.9 %
27 Sjeng_71c : 2036 791 409 4 25.0 % 2227 0.0 %
28 ChessterfieldCL_i4b : 2033 66 22 440 20.0 % 2273 5.5 %
29 DChess_102 : 2032 78 70 83 42.8 % 2083 10.8 %
30 Averno_028 : 1939 165 64 59 20.3 % 2176 3.4 %
31 TSCP_15 : 1878 128 158 16 28.1 % 2041 43.8 %
32 Faile_06 : 1758 0 0 11 0.0 % 2358 0.0 %
33 Freyr_987 : 1758 0 0 8 0.0 % 2358 0.0 %
34 Zephyr_05 : 1734 367 123 18 8.3 % 2151 5.6 %
35 Skaki_119 : 1687 223 166 12 58.3 % 1628 33.3 %
36 Monik_20 : 1627 224 111 21 9.5 % 2019 19.0 %
37 Tristram_416 : 1620 254 45 86 5.8 % 2104 4.7 %
38 Golem01 : 1595 306 148 14 7.1 % 2041 14.3 %
39 Pierre_17 : 1347 0 0 6 0.0 % 1947 0.0 %


My FTP site

[WYx]

Geschrieben von: / Posted by: WYx at 31 May 2000 12:43:18:
Als Antwort auf: / As an answer to: Battle of the Crowns -- calibration results so far geschrieben von: / posted by: Dann Corbit at 30 May 2000 21:13:22:

[Dann Corbit]

Geschrieben von: / Posted by: Dann Corbit at 31 May 2000 19:35:45:
Als Antwort auf: / As an answer to: Re: Colchess and crux ? (no text) geschrieben von: / posted by: WYx at 31 May 2000 12:43:18:
I intend to include both ColChess and Crux. There were some configuration problems, but I think I can get everything worked out before June 1st.
If worst comes to worst, I can get someone else to calibrate those engines and run the games for me.


My FTP site

[Aaron]

Geschrieben von: / Posted by: Aaron at 01 June 2000 19:20:03:
Als Antwort auf: / As an answer to: Battle of the Crowns -- calibration results so far geschrieben von: / posted by: Dann Corbit at 30 May 2000 21:13:22:

Note that some programs don't have a lot of games yet. Also, that ExChess and InmiChess got a bunch of easy points by playing a large number of games against a much weaker opponent. I will delay the actual contest as long as necessary -- which will be when the uncertainty figures for both +/- are less than 100 points for each program entered. ExChess_314c is going to be used instead of ExCh314w, and Sjeng_72 will be used rather than Sjeng_71c. I have played extensive side matches to validate which is stronger of these pairs. There is a new version of Noonian which will hopefully work with the latest version of Winboard.
Program Elo + - Games Score Av.Op. Draws
1 Crafty_17_10c : 2782 40 135 121 87.2 % 2449 10.7 %
2 SOS : 2691 66 110 65 71.5 % 2531 13.8 %
3 gromit3 : 2618 69 85 75 62.0 % 2533 14.7 %
4 Comet_B21 : 2600 38 53 210 66.2 % 2483 18.1 %
5 LGoliath_27 : 2589 106 118 36 47.2 % 2608 16.7 %
6 AnMon_506 : 2484 60 74 96 62.5 % 2396 16.7 %
7 Amy_07f : 2475 38 80 171 74.9 % 2285 10.5 %
8 TCBishop_0045 : 2455 99 100 42 41.7 % 2514 21.4 %
9 ExChess_314c : 2452 28 103 241 86.1 % 2136 8.7 %
10 InmiChess_303 : 2449 67 67 93 56.5 % 2404 18.3 %
11 GnuChess_50 : 2436 145 145 22 50.0 % 2436 18.2 %
12 Phalanx_22c : 2428 255 228 10 60.0 % 2358 20.0 %
13 GNUChess_414 : 2417 206 141 18 25.0 % 2608 16.7 %
14 ExCh314w : 2402 353 476 6 41.7 % 2461 16.7 %
15 Arasan_53 : 2389 53 46 167 51.8 % 2376 19.8 %
16 Ant_416 : 2387 40 51 203 63.5 % 2290 17.7 %
17 ZChess_120 : 2382 41 59 180 66.1 % 2266 15.6 %
18 Bringer_16 : 2350 49 52 158 58.9 % 2287 20.3 %
19 Dragon_311-2 : 2325 214 50 75 8.7 % 2734 6.7 %
20 Cilian_413 : 2230 65 45 144 32.6 % 2356 18.1 %
21 Knightx_153 : 2228 364 273 8 18.8 % 2483 12.5 %
22 lambChop_710 : 2226 287 203 10 10.0 % 2608 20.0 %
23 Sjeng_72 : 2219 196 173 16 37.5 % 2308 12.5 %
24 SSEchess_202 : 2165 97 56 83 25.9 % 2347 18.1 %
25 LDBlanche_20c : 2163 153 86 36 20.8 % 2395 19.4 %
26 Amyan_101 : 2127 44 52 206 55.8 % 2086 4.9 %
27 Sjeng_71c : 2036 791 409 4 25.0 % 2227 0.0 %
28 ChessterfieldCL_i4b : 2033 66 22 440 20.0 % 2273 5.5 %
29 DChess_102 : 2032 78 70 83 42.8 % 2083 10.8 %
30 Averno_028 : 1939 165 64 59 20.3 % 2176 3.4 %
31 TSCP_15 : 1878 128 158 16 28.1 % 2041 43.8 %
32 Faile_06 : 1758 0 0 11 0.0 % 2358 0.0 %
33 Freyr_987 : 1758 0 0 8 0.0 % 2358 0.0 %
34 Zephyr_05 : 1734 367 123 18 8.3 % 2151 5.6 %
35 Skaki_119 : 1687 223 166 12 58.3 % 1628 33.3 %
36 Monik_20 : 1627 224 111 21 9.5 % 2019 19.0 %
37 Tristram_416 : 1620 254 45 86 5.8 % 2104 4.7 %
38 Golem01 : 1595 306 148 14 7.1 % 2041 14.3 %
39 Pierre_17 : 1347 0 0 6 0.0 % 1947 0.0 %

Nice, the top few ranks appear to be conforming with expectations..(mine at least)
Phalanx could be higher i guess, but it's still had few games. Exchess314 (both versions) looks quite good..And Inmichess of course.
Also you are not testing Francesa? though it plays only x moves in Y time..

[Dann Corbit]

Geschrieben von: / Posted by: Dann Corbit at 01 June 2000 20:23:06:
Als Antwort auf: / As an answer to: Re: Battle of the Crowns -- calibration results so far geschrieben von: / posted by: Aaron at 01 June 2000 19:20:03:
[snip]

Nice, the top few ranks appear to be conforming with expectations..(mine at least)
Phalanx could be higher i guess, but it's still had few games. Exchess314 (both versions) looks quite good..And Inmichess of course.
Also you are not testing Francesa? though it plays only x moves in Y time..

I think that both the new ExChess and InmiChess have made great strides at long time control games. Their performance is going to raise a few eyebrows, I predict.
Today is the last day for me to receive a functional engine. All the games must be played in G/60 format. The tournament itself will actually be G/90, but calibration is at G/60.
Also, programs which often play illegal moves will be disqualified.
I may also add programs Yace and Gully2, with permissions of the authors to publish the binaries on my FTp site.


My FTP site

[Aaron]

Geschrieben von: / Posted by: Aaron at 01 June 2000 20:39:54:
Als Antwort auf: / As an answer to: Re: Battle of the Crowns -- calibration results so far geschrieben von: / posted by: Dann Corbit at 01 June 2000 20:23:06:

Also you are not testing Francesa? though it plays only x moves in Y time..

Today is the last day for me to receive a functional engine. All the games >must be played in G/60 format. The tournament itself will actually be G/90, >but calibration is at G/60.
Also, programs which often play illegal moves will be disqualified.
I may also add programs Yace and Gully2, with permissions of the authors to >publish the binaries on my FTp site.

Such a pity,Francesa is quite strong..Why not play the tournament "Battle of crowns" using X moves in Y time format?
I'm interested to know why you prefer the G/60 time of format? Unless you think that switching time controls will cause even more problems for other engines?

Hmm..They are?
Talking about Gully , you have being teasing us for some time now..IS it finally ready? Or are you going to waste untill it wins some tournament before releasing it? ( A trend now days)

[Dann Corbit]

Geschrieben von: / Posted by: Dann Corbit at 01 June 2000 22:16:58:
Als Antwort auf: / As an answer to: Re: Battle of the Crowns -- calibration results so far geschrieben von: / posted by: Aaron at 01 June 2000 20:39:54:

Also you are not testing Francesa? though it plays only x moves in Y time..

Today is the last day for me to receive a functional engine. All the games >must be played in G/60 format. The tournament itself will actually be G/90, >but calibration is at G/60.
Also, programs which often play illegal moves will be disqualified.
I may also add programs Yace and Gully2, with permissions of the authors to >publish the binaries on my FTp site.

Such a pity,Francesa is quite strong..Why not play the tournament "Battle of crowns" using X moves in Y time format?
I'm interested to know why you prefer the G/60 time of format? Unless you think that switching time controls will cause even more problems for other engines?

Hmm..They are?
Talking about Gully , you have being teasing us for some time now..IS it finally ready? Or are you going to waste untill it wins some tournament before releasing it? ( A trend now days)

Definitely Olithink. About 1/40 moves are simply illegal. Some others do so rarely.
Gully2 is not my program (bean-counter). I will include it if the author allows it.


My FTP site

[Dann Corbit]

Geschrieben von: / Posted by: Dann Corbit at 01 June 2000 22:22:08:
Als Antwort auf: / As an answer to: Re: Battle of the Crowns -- calibration results so far geschrieben von: / posted by: Aaron at 01 June 2000 20:39:54:

Also you are not testing Francesa? though it plays only x moves in Y time..

Today is the last day for me to receive a functional engine. All the games >must be played in G/60 format. The tournament itself will actually be G/90, >but calibration is at G/60.

Such a pity,Francesa is quite strong..Why not play the tournament "Battle of crowns" using X moves in Y time format?
I'm interested to know why you prefer the G/60 time of format? Unless you think that switching time controls will cause even more problems for other engines?

At G/90, the games are completely deterministic. They can't take more than 90+90=180 minutes = 3 hours. Therefore, I can run four games with /mg 4 and they will always be completed in 12 hours or less.
Other programs have problems with 60/1 type formats. I won't switch from one format to another during the tournament. All programs must obey the same time control. Simple as that.


My FTP site