It is currently 08 Sep 2025, 04:29
   
Text Size

mtg-data.txt db faults =(

Post MTG Forge Related Programming Questions Here

Moderators: timmermac, Blacksmith, KrazyTheFox, Agetian, friarsol, CCGHQ Admins

mtg-data.txt db faults =(

Postby Max mtg » 08 Mar 2013, 16:05

mtg data file is not a very good database.
Besides it has inaccurate data for split cards, It also lists some cards as if they were issued in Starter 2000, though they were printed only in 6th edition.
ex: http://gatherer.wizards.com/Pages/Card/ ... seid=25514
and all basic lands! Gatherer and mtg-data.txt are sure that S00 had a couple of basic lands of each type, but there are none in scans folders and obviuosly the cards listed as 'starter 2000' also bear the VI edition code.

I am thinking of other sources of information...
* Magiccards.info is more accurate but we don't have their database downloaded. - Should somehow DL whole of their database.
* May also parse magic online database, I've datamined its format some time before. - Should parse and build up a table of card-to-editions matches and check it for errors.
Single class for single responsibility.
Max mtg
Programmer
 
Posts: 1997
Joined: 02 Jul 2011, 14:26
Has thanked: 173 times
Been thanked: 334 times

Re: mtg-data.txt db faults =(

Postby Agetian » 08 Mar 2013, 16:14

Oh, good call! I was wondering about those S00 cards - was wondering if maybe I have an incomplete S00 set downloaded or something when I saw cards with missing pictures. And yeah, some setinfo's for the splits are inaccurate too. Would be very nice if you come up with an idea to compile a better database for Forge! Keep up the great work!

- Agetian
Agetian
Programmer
 
Posts: 3489
Joined: 14 Mar 2011, 05:58
Has thanked: 684 times
Been thanked: 572 times

Re: mtg-data.txt db faults =(

Postby friarsol » 08 Mar 2013, 16:15

Max mtg wrote:mtg data file is not a very good database.
Besides it has inaccurate data for split cards, It also lists some cards as if they were issued in Starter 2000, though they were printed only in 6th edition.
ex: http://gatherer.wizards.com/Pages/Card/ ... seid=25514
and all basic lands! Gatherer and mtg-data.txt are sure that S00 had a couple of basic lands of each type, but there are none in scans folders and obviuosly the cards listed as 'starter 2000' also bear the VI edition code.
Gatherer is the source which mtg-data grabs from. And Gatherer is the official source. If Gatherer incorrectly lists a card is being from a set, then it's a bug in Gatherer. Are you sure that the "official" source that lists a card as being from a set is incorrect, and the "unofficial" source that doesn't list the card is correct?

If I remember correctly, Starter 2000 had a bunch of new cards in it (like Portal) which didn't have a Set Icon, but it also used cards from 6th edition (the set out in the time) and didn't reprint them, just grabbed them straight from 6th edition cards.

So your Starter cards could have a 6th edition set icon on them, if they were one of these reprints.

The official checklist released in 2000 even lists your examples: http://www.wizards.com/magic/generic/ca ... cklist.txt
friarsol
Global Moderator
 
Posts: 7593
Joined: 15 May 2010, 04:20
Has thanked: 243 times
Been thanked: 965 times

Re: mtg-data.txt db faults =(

Postby Max mtg » 08 Mar 2013, 16:42

Sol, if the checklist is the most accurate, then the hq scans we have downloaded miss some 24 cards. So if we stick to the list, will have to fill the gaps in our downloaded collections...and all of players have to do so too.
Single class for single responsibility.
Max mtg
Programmer
 
Posts: 1997
Joined: 02 Jul 2011, 14:26
Has thanked: 173 times
Been thanked: 334 times

Re: mtg-data.txt db faults =(

Postby friarsol » 08 Mar 2013, 16:45

Max mtg wrote:Sol, if the checklist is the most accurate, then the hq scans we have downloaded miss some 24 cards. So if we stick to the list, will have to fill the gaps in our downloaded collections...and all of players have to do so too.
Isn't it much more likely that the HQ Picture team doesn't have a few scans of a set then the official check list of a set was incorrect?

Edit: viewtopic.php?f=15&t=445&p=84217&hilit=starter+200#p84217
friarsol
Global Moderator
 
Posts: 7593
Joined: 15 May 2010, 04:20
Has thanked: 243 times
Been thanked: 965 times

Re: mtg-data.txt db faults =(

Postby Max mtg » 08 Mar 2013, 17:01

So, what should we do?
Add some hardcodes meaning 'take 6ed for this card if it's missing in S00' or add any new options to setinfo?
Single class for single responsibility.
Max mtg
Programmer
 
Posts: 1997
Joined: 02 Jul 2011, 14:26
Has thanked: 173 times
Been thanked: 334 times

Re: mtg-data.txt db faults =(

Postby friarsol » 08 Mar 2013, 17:08

Max mtg wrote:So, what should we do?
Add some hardcodes meaning 'take 6ed for this card if it's missing in S00' or add any new options to setinfo?
Maybe we can just copy the appropriate card pics into the S00 folder so they'll be available for everyone on download? That seems to be what the HQ Pics guy is suggesting for people, and most importantly doesn't require extra programming or script changes.

I do hope that Arch can resolve his new bugs with the Split Cards though, mtgdata has been pretty useful for us in the past.
friarsol
Global Moderator
 
Posts: 7593
Joined: 15 May 2010, 04:20
Has thanked: 243 times
Been thanked: 965 times

Re: mtg-data.txt db faults =(

Postby Max mtg » 08 Mar 2013, 17:26

That 'we' also includes all players who use downloaded CCGHQ images.
You'll have to explain it to them in the next release notes ;)
Single class for single responsibility.
Max mtg
Programmer
 
Posts: 1997
Joined: 02 Jul 2011, 14:26
Has thanked: 173 times
Been thanked: 334 times

Re: mtg-data.txt db faults =(

Postby friarsol » 08 Mar 2013, 17:43

Max mtg wrote:That 'we' also includes all players who use downloaded CCGHQ images.
You'll have to explain it to them in the next release notes ;)
Haha. I was just thinking about the LQ Set images.. Wasn't even considering the other. It's definitely an odd scenario. Stupid Starter sets that aren't even a full set.
friarsol
Global Moderator
 
Posts: 7593
Joined: 15 May 2010, 04:20
Has thanked: 243 times
Been thanked: 965 times

Re: mtg-data.txt db faults =(

Postby Max mtg » 08 Mar 2013, 19:04

friarsol wrote:
Max mtg wrote:That 'we' also includes all players who use downloaded CCGHQ images.
You'll have to explain it to them in the next release notes ;)
Haha. I was just thinking about the LQ Set images.. Wasn't even considering the other. It's definitely an odd scenario. Stupid Starter sets that aren't even a full set.
So, are we agreed on hardcode, like if set==S00 and card image not found, try again with set=6ed?
Single class for single responsibility.
Max mtg
Programmer
 
Posts: 1997
Joined: 02 Jul 2011, 14:26
Has thanked: 173 times
Been thanked: 334 times

Re: mtg-data.txt db faults =(

Postby friarsol » 08 Mar 2013, 19:15

Max mtg wrote:So, are we agreed on hardcode, like if set==S00 and card image not found, try again with set=6ed?
Sure, it's not great, but since Starter 2000 seems to work exactly this way, it's probably the right way to handle things.
friarsol
Global Moderator
 
Posts: 7593
Joined: 15 May 2010, 04:20
Has thanked: 243 times
Been thanked: 965 times

Re: mtg-data.txt db faults =(

Postby Chris H. » 09 Mar 2013, 03:14

friarsol wrote:If I remember correctly, Starter 2000 had a bunch of new cards in it (like Portal) which didn't have a Set Icon, but it also used cards from 6th edition (the set out in the time) and didn't reprint them, just grabbed them straight from 6th edition cards.

So your Starter cards could have a 6th edition set icon on them, if they were one of these reprints.

The official checklist released in 2000 even lists your examples: http://www.wizards.com/magic/generic/ca ... cklist.txt
 
I checked the listing and there appears to be 24 cards from 6th and 1 card form 8th (Rhox) that are missing.

The archive below contains HQ pics for these cards. They need to be run through the script/commands that will scale them down in size and saved at less than 100%. At that point they need to be added to the Starter 2000 cards folder at cardforge.
 
Attachments
Missing Starter 2000 HQ pics.zip
(4.14 MiB) Downloaded 368 times
User avatar
Chris H.
Forge Moderator
 
Posts: 6320
Joined: 04 Nov 2008, 12:11
Location: Mac OS X Yosemite
Has thanked: 644 times
Been thanked: 643 times

Re: mtg-data.txt db faults =(

Postby Chris H. » 09 Mar 2013, 03:20

I attempted to download the new LQ card set pics that have been released to cardforge over the last year or so. This is the list of cards that as of today do not download.

the list | Open
Akroma's Vengeance [HOP - Planechase]
Ancient Den [HOP - Planechase]
Arc Lightning [HOP - Planechase]
Arcbound Crusher [HOP - Planechase]
Arcbound Slith [HOP - Planechase]
Armored Pegasus [S00 - Starter 2000]
Arsenal Thresher [HOP - Planechase]
Ascendant Evincar [HOP - Planechase]
AssaultBattery [HOP - Planechase]
Avatar of Hope [MBP - Media Insert Promo]
Balefire Liege [HOP - Planechase]
Battlegate Mimic [HOP - Planechase]
Beacon of Unrest [HOP - Planechase]
Beast Hunt [HOP - Planechase]
Beast of Burden [MBP - Media Insert Promo]
Beseech the Queen [HOP - Planechase]
Blaze [HOP - Planechase]
Bog Imp [S00 - Starter 2000]
Bogardan Firefiend [HOP - Planechase]
Bogardan Rager [HOP - Planechase]
Boros Garrison [HOP - Planechase]
Boros Guildmage [HOP - Planechase]
Boros Signet [HOP - Planechase]
Boros Swiftblade [HOP - Planechase]
Bosh, Iron Golem [HOP - Planechase]
Branching Bolt [HOP - Planechase]
Briarhorn [HOP - Planechase]
Broodstar [HOP - Planechase]
Browbeat [HOP - Planechase]
Bull Cerodon [HOP - Planechase]
Cabal Coffers [HOP - Planechase]
Cadaverous Knight [HOP - Planechase]
Cerodon Yearling [HOP - Planechase]
Cinder Elemental [HOP - Planechase]
Coercion [S00 - Starter 2000]
Cone of Flame [HOP - Planechase]
Congregate [HOP - Planechase]
Consume Spirit [HOP - Planechase]
Copper Myr [HOP - Planechase]
Corpse Harvester [HOP - Planechase]
Counterspell [S00 - Starter 2000]
Cranial Plating [HOP - Planechase]
Cruel Revival [HOP - Planechase]
Dark Ritual [HOP - Planechase]
Darksteel Forge [HOP - Planechase]
Death Baron [HOP - Planechase]
Dirtcowl Wurm [MBP - Media Insert Promo]
Disenchant [S00 - Starter 2000]
Door to Nothingness [HOP - Planechase]
Double Cleave [HOP - Planechase]
Dregscape Zombie [HOP - Planechase]
Drudge Skeletons [S00 - Starter 2000]
Duergar Hedge-Mage [HOP - Planechase]
Etched Oracle [HOP - Planechase]
Explosive Vegetation [HOP - Planechase]
Fabricate [HOP - Planechase]
False Prophet [MBP - Media Insert Promo]
Feral Throwback [MBP - Media Insert Promo]
Fertile Ground [HOP - Planechase]
Fertilid [HOP - Planechase]
Festering Goblin [HOP - Planechase]
Fires of Yavimaya [HOP - Planechase]
Flame Spirit [S00 - Starter 2000]
Flamekin Harbinger [HOP - Planechase]
Flametongue Kavu [HOP - Planechase]
Flight [S00 - Starter 2000]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forgotten Ancient [HOP - Planechase]
Fungal Shambler [MBP - Media Insert Promo]
Furnace of Rath [HOP - Planechase]
Giant Badger [MBP - Media Insert Promo]
Giant Growth [S00 - Starter 2000]
Glory [MBP - Media Insert Promo]
Glory of Warfare [HOP - Planechase]
Goblin Hero [S00 - Starter 2000]
Goblin Offensive [HOP - Planechase]
Gold Myr [HOP - Planechase]
Grave Pact [HOP - Planechase]
Gravedigger [HOP - Planechase]
Great Furnace [HOP - Planechase]
Gruul Turf [HOP - Planechase]
Hearthfire Hobgoblin [HOP - Planechase]
Helldozer [HOP - Planechase]
Helm of Kaldra [MBP - Media Insert Promo]
Hero's Resolve [S00 - Starter 2000]
Hideous End [HOP - Planechase]
Hull Breach [HOP - Planechase]
Incremental Blight [HOP - Planechase]
Innocent Blood [HOP - Planechase]
Inspiration [S00 - Starter 2000]
Insurrection [HOP - Planechase]
Iron Myr [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Ivy Elemental [HOP - Planechase]
Keep Watch [HOP - Planechase]
Keldon Champion [HOP - Planechase]
Kor Sanctifiers [HOP - Planechase]
Laquatus's Champion [MBP - Media Insert Promo]
Leaden Myr [HOP - Planechase]
Leechridden Swamp [HOP - Planechase]
Lightning Dragon [MBP - Media Insert Promo]
Lightning Helix [HOP - Planechase]
Living Hive [HOP - Planechase]
Llanowar Elves [S00 - Starter 2000]
Lodestone Myr [HOP - Planechase]
Loxodon Warhammer [HOP - Planechase]
Mage Slayer [HOP - Planechase]
Mask of Memory [HOP - Planechase]
Master of Etherium [HOP - Planechase]
Merfolk of the Pearl Trident [S00 - Starter 2000]
Monstrous Hound [MBP - Media Insert Promo]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Myr Enforcer [HOP - Planechase]
Nefashu [HOP - Planechase]
Noxious Ghoul [HOP - Planechase]
Nuisance Engine [HOP - Planechase]
Oblivion Ring [HOP - Planechase]
Obsianus Golem [S00 - Starter 2000]
Orcish Oriflamme [S00 - Starter 2000]
OrderChaos [HOP - Planechase]
Orim's Thunder [HOP - Planechase]
Overtaker [MBP - Media Insert Promo]
Pentad Prism [HOP - Planechase]
Pentavus [HOP - Planechase]
Phyrexian Arena [HOP - Planechase]
Phyrexian Ghoul [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Prison Term [HOP - Planechase]
Prodigal Sorcerer [S00 - Starter 2000]
Profane Command [HOP - Planechase]
Pyrotechnics [HOP - Planechase]
Python [S00 - Starter 2000]
Questing Phelddagrif [MBP - Media Insert Promo]
Qumulox [HOP - Planechase]
Raging Kavu [MBP - Media Insert Promo]
Rampant Growth [HOP - Planechase]
Rathi Assassin [MBP - Media Insert Promo]
Reckless Charge [HOP - Planechase]
Relentless Assault [HOP - Planechase]
Relic of Progenitus [HOP - Planechase]
Revenant [MBP - Media Insert Promo]
Rockslide Elemental [HOP - Planechase]
Rod of Ruin [S00 - Starter 2000]
Rolling Thunder [HOP - Planechase]
Rorix Bladewing [HOP - Planechase]
Rotting Rats [HOP - Planechase]
Rumbling Slum [HOP - Planechase]
Ryusei, the Falling Star [MBP - Media Insert Promo]
Samite Healer [S00 - Starter 2000]
Sarcomite Myr [HOP - Planechase]
Savage Twister [HOP - Planechase]
Scathe Zombies [S00 - Starter 2000]
Search for Tomorrow [HOP - Planechase]
Seat of the Synod [HOP - Planechase]
Serum Tank [HOP - Planechase]
Sewers of Estark [MBP - Media Insert Promo]
Shepherd of Rot [HOP - Planechase]
Shield of Kaldra [MBP - Media Insert Promo]
Shivan Oasis [HOP - Planechase]
Shock [S00 - Starter 2000]
Silent Specter [MBP - Media Insert Promo]
Silver Myr [HOP - Planechase]
Silverglade Elemental [HOP - Planechase]
Skeleton Shard [HOP - Planechase]
Sludge Strider [HOP - Planechase]
Smokebraider [HOP - Planechase]
Soul Collector [MBP - Media Insert Promo]
Soul Net [S00 - Starter 2000]
Soul Warden [HOP - Planechase]
Soulless One [HOP - Planechase]
Spined Wurm [S00 - Starter 2000]
Stone Rain [S00 - Starter 2000]
Sunhome, Fortress of the Legion [HOP - Planechase]
Suntouched Myr [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Sword of Kaldra [MBP - Media Insert Promo]
Syphon Mind [HOP - Planechase]
Syphon Soul [HOP - Planechase]
Taurean Mauler [HOP - Planechase]
Terramorphic Expanse [HOP - Planechase]
Terror [S00 - Starter 2000]
Thirst for Knowledge [HOP - Planechase]
Tornado Elemental [HOP - Planechase]
Tree of Tales [HOP - Planechase]
Tribal Unity [HOP - Planechase]
Undead Warchief [HOP - Planechase]
Vault of Whispers [HOP - Planechase]
Vedalken Engineer [HOP - Planechase]
Venerable Monk [S00 - Starter 2000]
Verdant Force [HOP - Planechase]
WaxWane [ARC - Archenemy]
Whiplash Trap [HOP - Planechase]
Wind Drake [S00 - Starter 2000]
Withered Wretch [HOP - Planechase]
Wizard Replica [HOP - Planechase]
Academy at Tolaria West [HOP - Planechase]
Aretopolis [PC2 - Planechase 2012 Edition]
Birds of Paradise Avatar [VAN - Vanguard]
Birds of Paradise Avatar [VAN - Vanguard]
Chaotic AEther [PC2 - Planechase 2012 Edition]
Erhnam Djinn Avatar [VAN - Vanguard]
Erhnam Djinn Avatar [VAN - Vanguard]
Feeding Grounds [HOP - Planechase]
Fields of Summer [HOP - Planechase]
Goblin Warchief Avatar [VAN - Vanguard]
Goblin Warchief Avatar [VAN - Vanguard]
Goldmeadow [HOP - Planechase]
Grinning Demon Avatar [VAN - Vanguard]
Grinning Demon Avatar [VAN - Vanguard]
Horizon Boughs [HOP - Planechase]
Jaya Ballard Avatar [VAN - Vanguard]
Krosa [HOP - Planechase]
Lethe Lake [HOP - Planechase]
Llanowar [HOP - Planechase]
Mutual Epiphany [PC2 - Planechase 2012 Edition]
Panopticon [HOP - Planechase]
Planewide Disaster [PC2 - Planechase 2012 Edition]
Platinum Angel Avatar [VAN - Vanguard]
Platinum Angel Avatar [VAN - Vanguard]
Prodigal Sorcerer Avatar [VAN - Vanguard]
Prodigal Sorcerer Avatar [VAN - Vanguard]
Raven's Run [HOP - Planechase]
Rith, the Awakener Avatar [VAN - Vanguard]
Rith, the Awakener Avatar [VAN - Vanguard]
Royal Assassin Avatar [VAN - Vanguard]
Royal Assassin Avatar [VAN - Vanguard]
Serra Angel Avatar [VAN - Vanguard]
Serra Angel Avatar [VAN - Vanguard]
Takenuma [PC2 - Planechase 2012 Edition]
Talon Gates [PC2 - Planechase 2012 Edition]
The AEther Flues [HOP - Planechase]
The Fourth Sphere [HOP - Planechase]
The Great Forest [HOP - Planechase]
The Hippodrome [HOP - Planechase]
Tradewind Rider Avatar [VAN - Vanguard]
Tradewind Rider Avatar [VAN - Vanguard]
Trail of the Mage-Rings [PC2 - Planechase 2012 Edition]
Truga Jungle [PC2 - Planechase 2012 Edition]
Undercity Reaches [HOP - Planechase]
Velis Vel [HOP - Planechase]
User avatar
Chris H.
Forge Moderator
 
Posts: 6320
Joined: 04 Nov 2008, 12:11
Location: Mac OS X Yosemite
Has thanked: 644 times
Been thanked: 643 times

Re: mtg-data.txt db faults =(

Postby myk » 09 Mar 2013, 05:53

I have a quick semi-related question: why is it that our set-specific LQ pics are on the cardforge server with base64-encoded names? Is this how we get them? Is this standard procedure?
Last edited by myk on 09 Mar 2013, 06:43, edited 1 time in total.
myk
 
Posts: 439
Joined: 17 Jan 2013, 02:39
Location: California
Has thanked: 38 times
Been thanked: 57 times

Re: mtg-data.txt db faults =(

Postby Max mtg » 09 Mar 2013, 06:26

Chris H. wrote: 
I checked the listing and there appears to be 24 cards from 6th and 1 card form 8th (Rhox) that are missing.

The archive below contains HQ pics for these cards. They need to be run through the script/commands that will scale them down in size and saved at less than 100%. At that point they need to be added to the Starter 2000 cards folder at cardforge.
 
There is no Rhox in online db at gatherer: http://gatherer.wizards.com/Pages/Searc ... anced&set=[%22Starter+2000%22]

Rhox from 8ed can by no chance get into starter 2000 boosters, because the new card design was launched in 2002 only.
It is also present in S00 folder of hq pictures provided by CCGHQ.



About planechase - I hand to rename my PCH folder from CCGHQ download into HOP.
I personally don't like that 'hop' abbreviation, because didn't find any confirmation on the net of this being official edition code. Magic online for instance calls them PC1 (first planechase) and PC2 (for 2012)
Single class for single responsibility.
Max mtg
Programmer
 
Posts: 1997
Joined: 02 Jul 2011, 14:26
Has thanked: 173 times
Been thanked: 334 times

Next

Return to Developer's Corner

Who is online

Users browsing this forum: No registered users and 67 guests

Main Menu

User Menu

Our Partners


Who is online

In total there are 67 users online :: 0 registered, 0 hidden and 67 guests (based on users active over the past 10 minutes)
Most users ever online was 7303 on 15 Jul 2025, 20:46

Users browsing this forum: No registered users and 67 guests

Login Form