OpenAI Five Benchmark Test & The International 8

[vc_row][vc_column width=”2/3″ el_class=”articlebody” css=”.vc_custom_1523270772654{padding-top: 10px !important;padding-right: 10px !important;padding-left: 10px !important;}”][vc_single_image image=”5791″ img_size=”full” alignment=”center” css=”.vc_custom_1531981741271{margin-bottom: 0px !important;}”][vc_row_inner content_placement=”middle” css=”.vc_custom_1523350157423{margin-left: 20px !important;}” el_class=”cat-tag”][vc_column_inner width=”1/4″ css=”.vc_custom_1523351002838{background-position: 0 0 !important;background-repeat: no-repeat !important;}” offset=”vc_hidden-xs”][vc_custom_heading text=”News” font_container=”tag:h3|font_size:12|text_align:left|color:%23ffffff|line_height:1″ use_theme_fonts=”yes” css=”.vc_custom_1524480392987{margin-top: 0px !important;padding-top: 10px !important;padding-bottom: 10px !important;padding-left: 20px !important;background-image: url(https://esportscentral.co.za/wp-content/uploads/2018/04/Rectangle-26.png?id=2528) !important;background-position: center !important;background-repeat: no-repeat !important;background-size: cover !important;}”][/vc_column_inner][vc_column_inner width=”1/4″][/vc_column_inner][vc_column_inner width=”1/4″][/vc_column_inner][vc_column_inner width=”1/4″][/vc_column_inner][/vc_row_inner][vc_custom_heading text=”OpenAI Five Benchmark Test & The International 8″ font_container=”tag:h2|font_size:28|text_align:left|color:%23ffffff” use_theme_fonts=”yes” css=”.vc_custom_1531980483433{margin-top: 0px !important;margin-bottom: 0px !important;padding-top: 20px !important;padding-bottom: 20px !important;padding-left: 20px !important;background-color: #262631 !important;}”][vc_custom_heading text=”Kirrin “ABalloon“ Holzapfel” font_container=”tag:p|font_size:13|text_align:left” use_theme_fonts=”yes” css=”.vc_custom_1531915777372{margin-top: 0px !important;padding-top: 10px !important;padding-right: 10px !important;padding-bottom: 10px !important;padding-left: 20px !important;background-color: #2a2b37 !important;}”][vc_separator color=”custom” css=”.vc_custom_1523350609771{margin-top: 0px !important;border-top-width: 0px !important;padding-top: 0px !important;}” accent_color=”#3b455a”][vc_column_text css=”.vc_custom_1531992753338{margin-top: 0px !important;padding-top: 20px !important;padding-left: 20px !important;}”]OpenAI is a nonprofit tech company co-founded and backed by the South African billionaire tech giant, Elon Musk. The company is tasked with creating an Artificial Intelligence program with the sole purpose of mastering the game of Dota 2 and beating human players at one of the more complex, competitive video games on the market. With Ti8 just a short while away, the OpenAI Five team is ready to benchmark their bots against a human team that includes Blitz, Cap, Fogged, and Merlini. The match will be casted on Twitch by Purge and ODPixel on the 5th of August at 21h30 SAST.

Why OpenAI?

You might be wondering why the waste of time and money on a project like this, and the answer is actually rather simple. One of the biggest challenges in designing Artificial Intelligence is scaling up variables. When the tasks are simple, there’s not too much trouble. When tasks become complicated, that’s when the AI starts to struggle. One way to look at it is how many choices are present for any given action.

In a game like chess the average amount of moves per game is 40. After each player makes one move the total amount of positions available, or game states, is 400. After two moves each, it becomes 72,084 game states. After three moves each? Over nine million. Let that sink in for a moment. No one knows what the average amount of moves for a game of Dota is, but the average count for OpenAI’s bot is 20,000 moves per game. Being able to create a bot that can handle a game like Dota 2 is an astronomical undertaking but if successful it will result in better AI in all future projects, game related or not.

It’s a disaster!

It’s been almost one year since OpenAI hit the main stage at Ti7. playing against top pro players in a 1v1 format and defeating them one after the other felt like one of the most unfair moments in Dota competitive play. The bot went up against some of the best solo pro players Dota 2 had to offer with names like Dendi and Sumail getting crushed in the mid lane. It meant so much in the tech community that the victory prompted a tweet from Bill Gates: “#AI bots just beat humans at the video game Dota 2. That’s a big deal, because their victory required teamwork and collaboration — a huge milestone in advancing artificial intelligence.”

After the showcase on the main stage, OpenAI was pitched against anyone who wanted to give it a go at the event. At the time players were heavily limited in what they could do; with rules and limitations on what hero they could play and what actions they could take. By the end of the event the bot had been beaten by many players, both professional and casual, who managed to find weaknesses in what the bot was capable of.

While the bot was extremely good at basic mechanical functions, such as last hitting, harassing, and executing its skills, it was not ready to play the full complexity of a 5v5 with all the nuances that Dota 2 has to offer. Is all that about to change?

Patience from Zhou

With Ti8 coming up soon, the team behind OpenAI have developed a new set of titans for humans to play against: OpenAI Five. While OpenAI Five is still being developed the team has aimed to have a 5v5 match versus a team made up of top players on the 5th of August 2018 as a benchmarking test in preparation for Ti8’s main stage. OpenAI have stipulated a few limitations for the match. They are: 

• Pool of 18 heroes (Axe, Crystal Maiden, Death Prophet, Earthshaker, Gyrocopter, Lich, Lion, Necrophos, Queen of Pain, Razor, Riki, Shadow Fiend, Slark, Sniper, Sven, Tidehunter, Viper, or Witch Doctor)
• No summons/illusions
• 5 invulnerable couriers, no exploiting them by scouting or tanking
• No Scan
• No Divine Rapier or Bottle

The OpenAI Five learning curve

To give you an idea of what the human players will be facing, OpenAI Five bots played 180 years worth of games against itself every day in a format known as reinforcement training. Teaching itself everything it can in a continuous stream of games through trial and error. Despite that, the team behind OpenAI Five are not certain they will win this year at Ti8 stating that: “We may not succeed: Dota 2 is one of the most popular and complex esports games in the world, with creative and motivated professionals who train year-round to earn part of Dota’s annual $40M prize pool.”

If you’re interested in some of the more nitty gritty details on how the bots function and what problems they have had to overcome you can go look at OpenAI’s own blog post at: https://blog.openai.com/openai-five/

So, is this the year where machines will overthrow even the most stalwart of professional players in a complex, live game? With Ti8 just around the corner, my bet’s on the bot’s getting a second win on the main stage.[/vc_column_text][/vc_column][vc_column width=”1/3″ offset=”vc_hidden-xs”][vc_basic_grid post_type=”post” max_items=”” style=”pagination” items_per_page=”8″ show_filter=”yes” element_width=”12″ gap=”10″ order=”ASC” filter_style=”dropdown” filter_default_title=”Matches” filter_align=”right” filter_color=”blue” item=”2271″ initial_loading_animation=”none” grid_id=”vc_gid:1531992707358-2f80d4a3-28b0-2″ taxonomies=”71, 84, 86, 88, 90, 92, 94, 110″ filter_source=”category” el_class=”results” css=”.vc_custom_1527564819677{background-color: #30303d !important;}”][vc_custom_heading text=”ALL MATCHES” font_container=”tag:p|font_size:10|text_align:center|color:%23ffffff” use_theme_fonts=”yes” css=”.vc_custom_1523611106929{padding-top: 20px !important;padding-bottom: 5px !important;background-color: #30303d !important;}” link=”url:https%3A%2F%2Fesportscentral.co.za%2Fall-matches%2F|||”][vc_empty_space][vc_basic_grid post_type=”post” max_items=”” style=”pagination” items_per_page=”8″ show_filter=”yes” element_width=”12″ gap=”10″ filter_style=”dropdown” filter_default_title=”Results” filter_align=”right” filter_color=”blue” item=”2271″ initial_loading_animation=”none” grid_id=”vc_gid:1531992707358-24c5ec36-8376-10″ taxonomies=”76, 85, 87, 89, 91, 93, 95, 111″ filter_source=”category” el_class=”results” css=”.vc_custom_1528177085357{background-color: #30303d !important;}”][vc_custom_heading text=”ALL RESULTS” font_container=”tag:p|font_size:10|text_align:center|color:%23ffffff” use_theme_fonts=”yes” css=”.vc_custom_1523611113209{padding-top: 20px !important;padding-bottom: 5px !important;background-color: #30303d !important;}” link=”url:https%3A%2F%2Fesportscentral.co.za%2Fall-results%2F|||”][/vc_column][/vc_row]