Using Forge for Playtesting DotP 2014
Posted: 08 Jun 2013, 08:34I have recently gotten back in to MtG, thanks to DotP. With the new DotP 2014 just around the corner, I started to wonder how I could better tune my decks this year.
I decided it would be best if I could conduct multiple AI vs AI matches and collect data about the matches to determine what cards worked better than others. Since DotP decks have limited variability in their construction, you could compare various deck builds and collect information quickly.
After browsing the forums a bit, I decided BotArena was the only program I could use that would simulate multiple AI matches and produce log files that I could parse to collect information. Now that Forge allows for AI to AI simulations I have adapted my code to parse Forge files. The only problem being that I must manually start every simulation, which can be tedious when simulating 50-100 games. However Forge has a wealth of cards and a great AI compared to BotArena. So far, everything is working well. I have started a Google Site to detail my work and provide the results of the simulations. The latest data contains a breakdown of all currently leaked decks in DotP 2014 in 1 v 1 simulations. Since the new sliver cards aren't up on Forge I can't simulate that deck nor the "Hunter's Strength" deck, since I don't have a true card list for it yet.
So far the information gleaned looks okay. I am conducting 50-100 head to head battles of the different decks and parsing the log files using Python. The AI plays aggressively and without prior knowledge of the other deck e.g. it frequently plays removal on 1/1 cards in the Eldrazi "Chant of Mul Daya" deck. "Avacyn's Glory" seems to have a clear advantage on all decks most likely due to it's copious amounts of removal.
What I would like from the community is some discussion on this. Does this seem like a good way to playtest decks? Is there some data that would be helpful in determining if a card is "critical" to a deck? What would be some good builds to test after the first basic builds? What am I doing wrong?
The spam filters are blocking the website url, simply google "Magic the Shattering" (in quotes). It should be the first one. Go to the "Simulation Data" tab for the latest mined data.
I decided it would be best if I could conduct multiple AI vs AI matches and collect data about the matches to determine what cards worked better than others. Since DotP decks have limited variability in their construction, you could compare various deck builds and collect information quickly.
After browsing the forums a bit, I decided BotArena was the only program I could use that would simulate multiple AI matches and produce log files that I could parse to collect information. Now that Forge allows for AI to AI simulations I have adapted my code to parse Forge files. The only problem being that I must manually start every simulation, which can be tedious when simulating 50-100 games. However Forge has a wealth of cards and a great AI compared to BotArena. So far, everything is working well. I have started a Google Site to detail my work and provide the results of the simulations. The latest data contains a breakdown of all currently leaked decks in DotP 2014 in 1 v 1 simulations. Since the new sliver cards aren't up on Forge I can't simulate that deck nor the "Hunter's Strength" deck, since I don't have a true card list for it yet.
So far the information gleaned looks okay. I am conducting 50-100 head to head battles of the different decks and parsing the log files using Python. The AI plays aggressively and without prior knowledge of the other deck e.g. it frequently plays removal on 1/1 cards in the Eldrazi "Chant of Mul Daya" deck. "Avacyn's Glory" seems to have a clear advantage on all decks most likely due to it's copious amounts of removal.
What I would like from the community is some discussion on this. Does this seem like a good way to playtest decks? Is there some data that would be helpful in determining if a card is "critical" to a deck? What would be some good builds to test after the first basic builds? What am I doing wrong?
The spam filters are blocking the website url, simply google "Magic the Shattering" (in quotes). It should be the first one. Go to the "Simulation Data" tab for the latest mined data.