Topic: AI-Training
Tibor |
Posted at: 2019-04-26, 13:59
You are right and considering big randomness, there is no guarantee that best performer is indeed absolutely best. F.e. if all your neighbors are week, you might look like extra good player/AI. But this is how it works also in nature...
BUT - if you test on "normal" maps, not all starting posts are equal and you would automatically prefer AI players from good position(s) But on periodic map this approach would be completely fine.... Top Quote |
WorldSavior |
Posted at: 2019-04-26, 14:11
It works like that in nature, but for our AI training it's bad.
Did you find out that the starting positions of Desert Tournaments have big quality differences? For me it looks like they are very similar. Edited: 2019-04-26, 14:20
Wanted to save the world, then I got widetracked Top Quote |
Tibor |
Posted at: 2019-04-26, 14:25
AI has like 4 more less independent lines/variants. Sometimes a variant dies-out, and another split into two/three lines. I hope it is clear the AI regardless of starting position pick random one from 4 WAI files... So inefficiencies does not kill entire training.....
Yes, some normal maps have minimal differences between starting points. But why to bother to split maps into "equal starting points" and "not equal starting points"? Edited: 2019-04-26, 14:26
Top Quote |
king_of_nowhere |
Posted at: 2019-04-26, 14:40
I agree that desert tournament is a great map for training, perhaps more variety of maps would be welcome. Unfortunately, one thing that is really difficult to do with the AI is that you have to adapt your strategy to the map, and the AI can't really do that. Desert tournament is great in that it balances early game with mid-late game, but it does llittle for a huge map with really late game big armies. I think ice wars would be a good map to temper the training with some adaptation for large maps.
the idea is that an inefficient training cycle that can be fully automathized and run authomatically a huge number of times is better than a more refinined process that requires human input and is slower. Inefficiencies caused by statistics tend to even out in the long run. It's the zerg rush equivalent of problem solving.
there are some small differences, one of the players have slightly more land and one slightly less. Not sure oon specifics, I remember during the 2015 tournament I was able to make one extra farm with a couple of starting places. Difference is minimal though, can be considered equal for all practical purposes. If you can train the AI to the point where that tiny difference actually matters, it's already a great success. Top Quote |
teppo |
Posted at: 2019-04-27, 14:49
Who does the scoring? I write down a verbal description of the occupied slot goodness of victory each time, and compare the essays to find the best ones after running all rounds?
Is there any way to check whether the new genes are better than old ones? Who makes the bundled WAI files? Are they good-enough for build 20? Top Quote |
stonerl Topic Opener |
Posted at: 2019-04-27, 16:58
As far as I understand, the major problem is that the AI would have to be trained on a map that covers all hurdles it could run into. e.g. if I train only on "The Crater", the AI would perform exceptional on this map but not on others? Some kind of automation would be nice. I can spend a lot of CPU time, but my personal time is quite limited. We then could train the AI for specific maps and load the WAI-files for the trained map. If no map specific WAI-files a present we then would fall back to standard WAI-files. Would such a thing possible? Top Quote |
Nordfriese |
Posted at: 2019-04-27, 17:16
In my opinion, a map with many challenges is poorly suited. E.g. if one AI increases its skill at seafaring but loses skill at coping with little space, and the other AI is the other way around, which one is better? In my opinion, it makes more sense to use many different maps each one of which has one big challenge, and the winning AIs are selected by how well they cope with the map´s particular challenge. (Regarding the other aspects in which the AI has to be trained, the map would have to match the AI´s current skill level though, so it doesn´t lose a skill again if it doesn´t need it there.) Top Quote |
WorldSavior |
Posted at: 2019-04-27, 17:17
For example in multiplayer matches it is useful to have equal starting points. For AI-training it should be useful as well.
At the other hand, distances between players on ice wars are not huge, so it can also be considered as mid-game map.
I think so. At the other hand it is not certain that a AI which is trained on a very hard map can play well on an easy map, is it? By the way, is anyone interested in creating a map which is very good for AI training? Wanted to save the world, then I got widetracked Top Quote |
teppo |
Posted at: 2019-04-27, 17:41
On the positive side: If somebody would go though the huge amount of work to make the training to happen by itself (=given enough CPU cycles, evolution progresses itself), then it would be possible for (some) maps to contain .wai files optimized for that map. Edited: 2019-04-27, 17:45
Top Quote |
Nordfriese |
Posted at: 2019-04-27, 17:47
On the other hand, the default wai files will be improved frequently, but the map´s wai replacement files probably won´t be. At some time the default AI might then perform better than the map´s. I´m against map-specific AI files as it would require too much maintenance to be efficient… Top Quote |