Gomocup 2015, the 16th tournament (May the 1st-3th, 2015)

The Gomocup 2015 took place on May the 1st-3th. All the games were run on one of following configurations:

  • Windows 8.1, x64 Intel Core i7 (Ivy Bridge) 3630QM(2.4/3.4GHz), 8GB RAM.
  • Windows 7, x64 Intel Core i7 TODO, 8GB RAM.
  • Windows 7, x64 Intel Core i5(Haswell) 4210M(2.6/3.2GHz), 4GB RAM

The piskvork server was set up to the computer in datacentre with public IP and connected to the backhaul network. There was no change in Gomocup Online. It remain the same as in 2014.

Openings for gomocup 2015 were again choosen by Alexander Bogatirev, gomoku player, manager of Team Russia online, member of Gomoku Committee RIF and can be found here. Thanks to Alexander.

What is new?

UPDATES

  • Goro 2015 - quite different
  • Hewer 2015 - faster, more strategic
  • SlowRenju 2015 - improvement of searching algorithms and parameters
  • Swine 2015 - more correct algorithm
  • Kanec 2015 - not confirmed because of crashing, Kanec09 was used instead
  • Yixin 2015 - algorithm has been improved and a bug has been fixed
  • Zetor 2015 - bugs fixed
  • Imro 2015 - improoved

NEW AI

  • AcePela2 - open source AI based on Pela, source code and modifications are inlcuded
  • XoXo15

Unfortunatelly Kanec 2015 does not passed the initial testing, because it was crashing too often.
Jarek tried his best to fix it, he fixed some bugs, but still the crash rate was too high.
I hope it will be fixed till the next Gomocup.

There were difficulties like every year, some were technical other were caused by human factor (me).

Freestyle has to be restarted several times. Firstly there were problems with two AIs. HighFive,
which worked fine in 2014 and no it tunred out that it does not work in 2015 on the same computer.
The problem was with some security issue and UAC on Windows 8.1.
It still worked on Windws 7 computer, so all games with HighFive were running on computer with Windows 7.

Another problem was cause by AcePela which was successfully tested on Windows 8.1 and Windows XP SP3,
but on the beggining of tournament appearded, that it crash on some computers, sometime.
So I decided to compile it from sourcode which was provided by author (because od GPL) and it worked on the seconds attempt.

Another restart of freestyle 3 was caused by problem when a freestyle rule was set on server and standard rule was set on clients and it seems that piskvork does not propagate the rule over network (TODO check later).

 

Tournament Time limit per move [s] Time limit per match [s] Memory limit [MB] Board size More than five in row wins
Freestyle 1.league 300 1000 350 20 yes
Freestyle 2.league 30 180 350 20 yes
Freestyle 3.league 30 180 350 20 yes
Freestyle 4.league 30 180 350 20 yes
Fastgame 5 120 350 20 yes
Standard 300 1000 350 15 no

 

Ranking and groups before the tournament

Tournament system was similiar to the last one. I set up a rank according to last tournament and the Ai were divided into 3 groups. From every league, the first three were moving up.

RANKING 2014

Ranking
1.
    YIXIN2014
    RENJUSOLVER
    HEWER2014
    TITO2014
    SWINE2014
    HGARDEN07
    GORO2014
    PELA
    GMOTOR11
    +3
------------------------------------
    2.
    SLOWRENJU2014
    KANEC
    HIGHFIVE
    JUDE
    AMOEBA10
    ZETOR
    QMENTAT6
    PECUCHET
    NOESIS
    NABAMOKU
    +3
----------------------
3.
    PUSKVOREC
    PUREGM12
    LICHT14
    FAST-GOMOKU14
    PISQ7
    IMRO13
    FIVEROW
    PROLOG
    BENJAMIN
    VALKYRIE
    CRUSHER10
    MUSHROOM

Results of Gomocup 3. freestyle gomoku leaguePiskvork tournament result

Results of Gomocup 2. freestyle gomoku league

Results of Gomocup 1. freestyle gomoku league

Compared to the Gomocup 2014, there were 12 engines in the final group. AcePela, SlowRenju and HighFive advanced to the final.

Yixin was shampion from 2012 and this year new updated version was annouced. But there were a possibility for suprisal, because there were several new AI in first group.
A lot of questions were made about AcePela, a open source branch of Pela made by Farmer Lu as part of his Thesis.

Yixin was excelating from the begging to the end of the tournament and end up with even higher ratio than in 2014 with only 5 lost of 88 matches.
Yixin showed his power and finished like a new Gomocup 2015 winner again.
The winner of Gomocup 2015 is Yixin written by Kai Sun from China, congratulation!!!.
On the 2nd was taken again by RenjuSolver written by Xiang Don Wen and on the third place was taken by Tito written by Andrej Tokarjev in 2011.

Congratulation to Kai Sun (China), the author of Yixin.

In the end the Gomocup results are converted to Elo rankings.

These ranking are not the results of Gomocup 2015, but only another measure how it could be if different algorihtm is used.
Gomocup 2015
Using Bayesian Elo (http://remi.coulom.free.fr/Bayesian-Elo/)
Offset 1500
Freestyle (Freestyle 1,2,3 & Fastgame)
Rank Name           Elo    +    - games score oppo. draws
   1 yixin15       2727  115   92   320   98%  1606    0%
   2 goro15        2418   68   63   320   88%  1621    0%
   3 RenjuSolver   2366   90   84    88   72%  2099    0%
   4 Tito2014      2244   59   57   320   80%  1630    0%
   5 hewer15       2242   59   57   320   81%  1630    0%
   6 HGarden07     2169   57   55   320   77%  1634    0%
   7 sWINe15       2112   56   55   320   74%  1637    0%
   8 acePela15     1977   48   47   520   78%  1470    0%
   9 gmotor2011    1958   54   54   320   66%  1644    0%
  10 pela          1859   54   54   320   61%  1649    0%
  11 SlowRenju15   1720   46   45   416   57%  1607    0%
  12 HighFive      1666   61   61   184   43%  1790    0%
  13 Kanec09       1639   50   49   328   63%  1463    0%
  14 amoeba10      1562   48   47   328   59%  1467    0%
  15 zetor15       1524   47   46   328   56%  1469    0%
  16 jude          1466   46   45   328   52%  1472    0%
  17 Pecuchet      1333   46   46   328   42%  1478    0%
  18 licht14       1330   52   51   336   53%  1341    0%
  19 imro15        1300   49   48   336   52%  1342    0%
  20 QMENTAT6      1291   45   45   328   39%  1480    0%
  21 Noesis        1240   72   78    96   28%  1484    0%
  22 pisq7         1217   40   40   432   42%  1377    0%
  23 nabamoku      1208   46   47   328   34%  1484    0%
  24 Puskvorec     1204   40   40   432   41%  1378    0%
  25 valkyrie      1055   46   46   336   35%  1354    0%
  26 Benjamin      1022   45   46   336   33%  1356    1%
  27 PureGM13       973   47   48   336   30%  1358    0%
  28 XoXo15         898   47   48   336   25%  1362    0%
  29 Crusher10      891   47   48   336   24%  1362    0%
  30 prolog         818   49   51   336   21%  1365    0%
  31 fastgomoku15   799   50   52   336   19%  1366    1%
  32 fiverow        704   54   57   336   15%  1371    0%
  33 mushroom       565   62   70   336    8%  1377    0%
Standard Group
Rank Name          Elo    +    - games score oppo. draws
   1 yixin15      2187  193  133    64   97%  1414    0%
   2 Tito2014     1896  115  103    64   81%  1450    0%
   3 hewer15      1820  108   97    64   77%  1460    0%
   4 pela         1463   89   90    64   46%  1505    2%
   5 gmotor2011   1457   89   91    64   45%  1505    2%
   6 acePela15    1415   88   90    64   42%  1511    3%
   7 SlowRenju15  1387   90   92    64   41%  1514    0%
   8 zetor15      1149   97  111    64   22%  1544    0%
   9 valkyrie      726  160  303    64    0%  1597    0%
Combined Result (Freestyle1,2,3 & Fastgame & Standard)
Rank Name           Elo    +    - games score oppo. draws
   1 yixin15       2731  105   84   384   97%  1643    0%
   2 goro15        2425   68   64   320   88%  1622    0%
   3 RenjuSolver   2372   90   84    88   72%  2103    0%
   4 Tito2014      2272   54   52   384   80%  1672    0%
   5 hewer15       2254   53   51   384   80%  1673    0%
   6 HGarden07     2173   57   56   320   77%  1635    0%
   7 sWINe15       2115   56   55   320   74%  1637    0%
   8 acePela15     1952   43   43   584   74%  1521    0%
   9 gmotor2011    1943   48   48   384   62%  1692    0%
  10 pela          1867   48   48   384   58%  1697    0%
  11 SlowRenju15   1734   42   42   480   55%  1652    0%
  12 HighFive      1666   61   61   184   43%  1791    0%
  13 Kanec09       1639   50   49   328   63%  1463    0%
  14 amoeba10      1561   48   47   328   59%  1467    0%
  15 zetor15       1525   44   44   392   51%  1551    0%
  16 jude          1465   46   45   328   52%  1471    0%
  17 Pecuchet      1332   46   46   328   42%  1478    0%
  18 licht14       1328   52   51   336   53%  1339    0%
  19 imro15        1298   49   48   336   52%  1341    0%
  20 QMENTAT6      1289   45   45   328   39%  1480    0%
  21 Noesis        1239   73   78    96   28%  1482    0%
  22 pisq7         1215   40   40   432   42%  1376    0%
  23 nabamoku      1207   46   47   328   34%  1484    0%
  24 Puskvorec     1202   40   40   432   41%  1377    0%
  25 valkyrie      1049   46   46   400   30%  1462    0%
  26 Benjamin      1019   45   46   336   33%  1354    1%
  27 PureGM13       970   47   48   336   30%  1356    0%
  28 XoXo15         895   47   48   336   25%  1360    0%
  29 Crusher10      888   47   48   336   24%  1360    0%
  30 prolog         815   49   51   336   21%  1364    0%
  31 fastgomoku15   796   50   52   336   19%  1365    1%
  32 fiverow        700   54   57   336   15%  1369    0%
  33 mushroom       561   62   70   336    8%  1376    0%
Fastgame Only
Rank Name           Elo    +    - games score oppo. draws
   1 yixin15       2711  149  127   232   99%  1458    0%
   2 goro15        2439  102   90   232   93%  1468    0%
   3 hewer15       2254   83   77   232   88%  1474    0%
   4 Tito2014      2238   82   77   232   87%  1475    0%
   5 HGarden07     2154   78   74   232   84%  1477    0%
   6 sWINe15       2037   72   69   232   79%  1481    0%
   7 acePela15     2004   71   68   232   78%  1483    0%
   8 gmotor2011    1992   72   69   232   78%  1483    0%
   9 pela          1966   71   68   232   77%  1484    0%
  10 Kanec09       1711   64   63   232   63%  1493    0%
  11 SlowRenju15   1702   64   63   232   63%  1493    0%
  12 licht14       1607   62   61   232   57%  1496    0%
  13 amoeba10      1570   61   60   232   56%  1498    0%
  14 zetor15       1527   60   60   232   53%  1499    0%
  15 jude          1485   61   60   232   51%  1501    0%
  16 Pecuchet      1398   61   61   232   46%  1504    0%
  17 QMENTAT6      1367   59   59   232   44%  1505    0%
  18 imro15        1350   60   60   232   43%  1505    0%
  19 nabamoku      1280   60   60   232   39%  1508    0%
  20 pisq7         1253   60   60   232   38%  1509    0%
  21 Puskvorec     1247   59   60   232   37%  1509    0%
  22 valkyrie      1083   62   63   232   27%  1514    0%
  23 Benjamin      1048   60   62   232   25%  1516    1%
  24 Crusher10      917   63   67   232   18%  1520    0%
  25 XoXo15         910   64   67   232   18%  1520    0%
  26 prolog         853   67   70   232   16%  1522    0%
  27 PureGM13       815   69   73   232   15%  1524    0%
  28 fastgomoku15   804   69   73   232   14%  1524    0%
  29 fiverow        694   76   82   232   10%  1528    0%
  30 mushroom       581   84   97   232    6%  1532    0%
Freestyle without Fastgame (Freestyle 1,2,3)
Rank Name           Elo    +    - games score oppo. draws
   1 yixin15       2760  112  112    88   94%  2123    0%
   2 goro15        2452   90   83    88   75%  2151    0%
   3 RenjuSolver   2430   88   83    88   72%  2153    0%
   4 Tito2014      2317   81   80    88   61%  2163    0%
   5 hewer15       2295   81   78    88   63%  2165    0%
   6 sWINe15       2281   82   80    88   59%  2167    0%
   7 HGarden07     2256   80   78    88   58%  2169    0%
   8 acePela15     2013   65   64   288   77%  1482    0%
   9 gmotor2011    2003   79   82    88   34%  2192    0%
  10 SlowRenju15   1809   64   64   184   50%  1815    0%
  11 pela          1798   90  100    88   18%  2211    0%
  12 HighFive      1702   63   63   184   43%  1824    0%
  13 amoeba10      1635   79   75    96   66%  1467    0%
  14 Kanec09       1623   78   75    96   64%  1468    0%
  15 zetor15       1605   77   74    96   64%  1469    0%
  16 jude          1519   73   71    96   55%  1477    0%
  17 Pecuchet      1316   73   76    96   34%  1494    0%
  18 QMENTAT6      1249   75   80    96   28%  1499    0%
  19 Noesis        1245   75   80    96   28%  1499    0%
  20 imro15        1216   84   75   104   73%   987    0%
  21 pisq7         1192   57   56   200   48%  1236    0%
  22 Puskvorec     1170   56   56   200   47%  1238    0%
  23 nabamoku      1160   80   87    96   22%  1507    0%
  24 PureGM13      1119   75   71   104   64%   994    0%
  25 valkyrie      1003   72   70   104   53%  1003    0%
  26 Benjamin       974   68   67   104   50%  1006    1%
  27 licht14        908   70   70   104   44%  1011    0%
  28 XoXo15         863   67   69   104   39%  1014    0%
  29 Crusher10      840   67   70   104   38%  1016    0%
  30 fastgomoku15   779   70   73   104   32%  1021    1%
  31 prolog         758   70   73   104   31%  1022    0%
  32 fiverow        684   75   80   104   25%  1028    0%
  33 mushroom       527   85  100   104   13%  1040    0%
Freestyle 1 Only
Rank Name          Elo    +    - games score oppo. draws
   1 yixin15      2077  140  104    88   94%  1448    0%
   2 goro15       1773   85   78    88   75%  1475    0%
   3 RenjuSolver  1751   83   78    88   72%  1477    0%
   4 Tito2014     1638   77   75    88   61%  1487    0%
   5 hewer15      1617   76   73    88   63%  1489    0%
   6 sWINe15      1603   77   76    88   59%  1491    0%
   7 HGarden07    1578   75   73    88   58%  1493    0%
   8 acePela15    1346   73   77    88   35%  1514    0%
   9 gmotor2011   1327   74   78    88   34%  1516    0%
  10 SlowRenju15  1135   84   93    88   18%  1533    0%
  11 pela         1124   85   94    88   18%  1534    0%
  12 HighFive     1031   92  107    88   13%  1543    0%

Standard gomoku tournament is played on board of size 15x15 fields and exactly five stones in row wins. The openings are adjusted compared to the freestyle gomoku.

There was a new AI AcePela supporting standard gomoku, because Pele supported standard gomoku too.

The results were different then last year. The tournament was very tight in 2014, but Yixin was dominating in 2015 and won the standard game. Congratulation to Yixin again!!

The winner of standard group was Yixin by Kai Sun, second was Tito written by Andrej Tokarjev, the third was Hewer written by Tomas Kubes.

The AI in the Fast Game were order according to Gomocup 2014 results, so the strongest AI matched in the end.

The FastGame was dominated by Yixin.
Congratulation to the Yixin and the author Kai Sun from China. The second was Goro and the third was Hewer. It was the same order as in 2014.

You can download complete results and openings here