Influence maps quantify units using handcrafted equations. Most related work in navigation used influence maps or potential fields. Navigation aims to provide reasonable destination spots and efficient routes for agents. Related work has also been done in explicit macro strategy operation, mostly focused on navigation.
MACRO MANAGEMENT GAME PROFESSIONAL
However, OpenAI Five was not able to defeat professional teams due to weakness in macro strategy management. OpenAI’s approach did not explicitly model macro strategy and tried to learn the entire game using micro level play. OpenAI Five has shown strong teamfights skills and coordination comparable to top professional Dota2 teams during a demonstration match held in The International 2018. OpenAI Five was trained directly on micro level action space using proximal policy optimization algorithms along with team rewards. So far, Dota2 AI developed by OpenAI using reinforcement learning, i.e., OpenAI Five, has made the most advanced progress. In recent study, much attention and attempts have been put to micro level execution. To master RTS games, players need to have strong skills in both macro strategy operation and micro level execution. Our 5-AI team achieves a 48% winning rate against human player teams which are ranked top 1% in the player ranking system. We perform comprehensive evaluations on a popular 5v5 Multiplayer Online Battle Arena (MOBA) game. Moreover, each of the agents makes independent strategy decisions, while simultaneously communicating with the allies through leveraging a novel imitated cross-agent communication mechanism. Trained by the Hierarchical Macro Strategy model, agents explicitly make macro strategy decisions and further guide their micro level execution. In this paper, we propose a novel learning-based Hierarchical Macro Strategy model for mastering MOBA games, a sub-genre of RTS games.
Recently, great progress has been made in micro level execution, while complete solutions for macro strategies are still lacking. Mastering RTS games requires both strong macro strategies and delicate micro level execution. RTS games provide partially observable gaming environments, where agents interact with one another in an action space much larger than that of GO. The next challenge of game AI lies in Real Time Strategy (RTS) games.
0 kommentar(er)
