Page 1 of 3

mtg-data.txt db faults =(

PostPosted: 08 Mar 2013, 16:05
by Max mtg
mtg data file is not a very good database.
Besides it has inaccurate data for split cards, It also lists some cards as if they were issued in Starter 2000, though they were printed only in 6th edition.
ex: http://gatherer.wizards.com/Pages/Card/ ... seid=25514
and all basic lands! Gatherer and mtg-data.txt are sure that S00 had a couple of basic lands of each type, but there are none in scans folders and obviuosly the cards listed as 'starter 2000' also bear the VI edition code.

I am thinking of other sources of information...
* Magiccards.info is more accurate but we don't have their database downloaded. - Should somehow DL whole of their database.
* May also parse magic online database, I've datamined its format some time before. - Should parse and build up a table of card-to-editions matches and check it for errors.

Re: mtg-data.txt db faults =(

PostPosted: 08 Mar 2013, 16:14
by Agetian
Oh, good call! I was wondering about those S00 cards - was wondering if maybe I have an incomplete S00 set downloaded or something when I saw cards with missing pictures. And yeah, some setinfo's for the splits are inaccurate too. Would be very nice if you come up with an idea to compile a better database for Forge! Keep up the great work!

- Agetian

Re: mtg-data.txt db faults =(

PostPosted: 08 Mar 2013, 16:15
by friarsol
Max mtg wrote:mtg data file is not a very good database.
Besides it has inaccurate data for split cards, It also lists some cards as if they were issued in Starter 2000, though they were printed only in 6th edition.
ex: http://gatherer.wizards.com/Pages/Card/ ... seid=25514
and all basic lands! Gatherer and mtg-data.txt are sure that S00 had a couple of basic lands of each type, but there are none in scans folders and obviuosly the cards listed as 'starter 2000' also bear the VI edition code.
Gatherer is the source which mtg-data grabs from. And Gatherer is the official source. If Gatherer incorrectly lists a card is being from a set, then it's a bug in Gatherer. Are you sure that the "official" source that lists a card as being from a set is incorrect, and the "unofficial" source that doesn't list the card is correct?

If I remember correctly, Starter 2000 had a bunch of new cards in it (like Portal) which didn't have a Set Icon, but it also used cards from 6th edition (the set out in the time) and didn't reprint them, just grabbed them straight from 6th edition cards.

So your Starter cards could have a 6th edition set icon on them, if they were one of these reprints.

The official checklist released in 2000 even lists your examples: http://www.wizards.com/magic/generic/ca ... cklist.txt

Re: mtg-data.txt db faults =(

PostPosted: 08 Mar 2013, 16:42
by Max mtg
Sol, if the checklist is the most accurate, then the hq scans we have downloaded miss some 24 cards. So if we stick to the list, will have to fill the gaps in our downloaded collections...and all of players have to do so too.

Re: mtg-data.txt db faults =(

PostPosted: 08 Mar 2013, 16:45
by friarsol
Max mtg wrote:Sol, if the checklist is the most accurate, then the hq scans we have downloaded miss some 24 cards. So if we stick to the list, will have to fill the gaps in our downloaded collections...and all of players have to do so too.
Isn't it much more likely that the HQ Picture team doesn't have a few scans of a set then the official check list of a set was incorrect?

Edit: viewtopic.php?f=15&t=445&p=84217&hilit=starter+200#p84217

Re: mtg-data.txt db faults =(

PostPosted: 08 Mar 2013, 17:01
by Max mtg
So, what should we do?
Add some hardcodes meaning 'take 6ed for this card if it's missing in S00' or add any new options to setinfo?

Re: mtg-data.txt db faults =(

PostPosted: 08 Mar 2013, 17:08
by friarsol
Max mtg wrote:So, what should we do?
Add some hardcodes meaning 'take 6ed for this card if it's missing in S00' or add any new options to setinfo?
Maybe we can just copy the appropriate card pics into the S00 folder so they'll be available for everyone on download? That seems to be what the HQ Pics guy is suggesting for people, and most importantly doesn't require extra programming or script changes.

I do hope that Arch can resolve his new bugs with the Split Cards though, mtgdata has been pretty useful for us in the past.

Re: mtg-data.txt db faults =(

PostPosted: 08 Mar 2013, 17:26
by Max mtg
That 'we' also includes all players who use downloaded CCGHQ images.
You'll have to explain it to them in the next release notes ;)

Re: mtg-data.txt db faults =(

PostPosted: 08 Mar 2013, 17:43
by friarsol
Max mtg wrote:That 'we' also includes all players who use downloaded CCGHQ images.
You'll have to explain it to them in the next release notes ;)
Haha. I was just thinking about the LQ Set images.. Wasn't even considering the other. It's definitely an odd scenario. Stupid Starter sets that aren't even a full set.

Re: mtg-data.txt db faults =(

PostPosted: 08 Mar 2013, 19:04
by Max mtg
friarsol wrote:
Max mtg wrote:That 'we' also includes all players who use downloaded CCGHQ images.
You'll have to explain it to them in the next release notes ;)
Haha. I was just thinking about the LQ Set images.. Wasn't even considering the other. It's definitely an odd scenario. Stupid Starter sets that aren't even a full set.
So, are we agreed on hardcode, like if set==S00 and card image not found, try again with set=6ed?

Re: mtg-data.txt db faults =(

PostPosted: 08 Mar 2013, 19:15
by friarsol
Max mtg wrote:So, are we agreed on hardcode, like if set==S00 and card image not found, try again with set=6ed?
Sure, it's not great, but since Starter 2000 seems to work exactly this way, it's probably the right way to handle things.

Re: mtg-data.txt db faults =(

PostPosted: 09 Mar 2013, 03:14
by Chris H.
friarsol wrote:If I remember correctly, Starter 2000 had a bunch of new cards in it (like Portal) which didn't have a Set Icon, but it also used cards from 6th edition (the set out in the time) and didn't reprint them, just grabbed them straight from 6th edition cards.

So your Starter cards could have a 6th edition set icon on them, if they were one of these reprints.

The official checklist released in 2000 even lists your examples: http://www.wizards.com/magic/generic/ca ... cklist.txt
 
I checked the listing and there appears to be 24 cards from 6th and 1 card form 8th (Rhox) that are missing.

The archive below contains HQ pics for these cards. They need to be run through the script/commands that will scale them down in size and saved at less than 100%. At that point they need to be added to the Starter 2000 cards folder at cardforge.
 

Re: mtg-data.txt db faults =(

PostPosted: 09 Mar 2013, 03:20
by Chris H.
I attempted to download the new LQ card set pics that have been released to cardforge over the last year or so. This is the list of cards that as of today do not download.

the list | Open
Akroma's Vengeance [HOP - Planechase]
Ancient Den [HOP - Planechase]
Arc Lightning [HOP - Planechase]
Arcbound Crusher [HOP - Planechase]
Arcbound Slith [HOP - Planechase]
Armored Pegasus [S00 - Starter 2000]
Arsenal Thresher [HOP - Planechase]
Ascendant Evincar [HOP - Planechase]
AssaultBattery [HOP - Planechase]
Avatar of Hope [MBP - Media Insert Promo]
Balefire Liege [HOP - Planechase]
Battlegate Mimic [HOP - Planechase]
Beacon of Unrest [HOP - Planechase]
Beast Hunt [HOP - Planechase]
Beast of Burden [MBP - Media Insert Promo]
Beseech the Queen [HOP - Planechase]
Blaze [HOP - Planechase]
Bog Imp [S00 - Starter 2000]
Bogardan Firefiend [HOP - Planechase]
Bogardan Rager [HOP - Planechase]
Boros Garrison [HOP - Planechase]
Boros Guildmage [HOP - Planechase]
Boros Signet [HOP - Planechase]
Boros Swiftblade [HOP - Planechase]
Bosh, Iron Golem [HOP - Planechase]
Branching Bolt [HOP - Planechase]
Briarhorn [HOP - Planechase]
Broodstar [HOP - Planechase]
Browbeat [HOP - Planechase]
Bull Cerodon [HOP - Planechase]
Cabal Coffers [HOP - Planechase]
Cadaverous Knight [HOP - Planechase]
Cerodon Yearling [HOP - Planechase]
Cinder Elemental [HOP - Planechase]
Coercion [S00 - Starter 2000]
Cone of Flame [HOP - Planechase]
Congregate [HOP - Planechase]
Consume Spirit [HOP - Planechase]
Copper Myr [HOP - Planechase]
Corpse Harvester [HOP - Planechase]
Counterspell [S00 - Starter 2000]
Cranial Plating [HOP - Planechase]
Cruel Revival [HOP - Planechase]
Dark Ritual [HOP - Planechase]
Darksteel Forge [HOP - Planechase]
Death Baron [HOP - Planechase]
Dirtcowl Wurm [MBP - Media Insert Promo]
Disenchant [S00 - Starter 2000]
Door to Nothingness [HOP - Planechase]
Double Cleave [HOP - Planechase]
Dregscape Zombie [HOP - Planechase]
Drudge Skeletons [S00 - Starter 2000]
Duergar Hedge-Mage [HOP - Planechase]
Etched Oracle [HOP - Planechase]
Explosive Vegetation [HOP - Planechase]
Fabricate [HOP - Planechase]
False Prophet [MBP - Media Insert Promo]
Feral Throwback [MBP - Media Insert Promo]
Fertile Ground [HOP - Planechase]
Fertilid [HOP - Planechase]
Festering Goblin [HOP - Planechase]
Fires of Yavimaya [HOP - Planechase]
Flame Spirit [S00 - Starter 2000]
Flamekin Harbinger [HOP - Planechase]
Flametongue Kavu [HOP - Planechase]
Flight [S00 - Starter 2000]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forgotten Ancient [HOP - Planechase]
Fungal Shambler [MBP - Media Insert Promo]
Furnace of Rath [HOP - Planechase]
Giant Badger [MBP - Media Insert Promo]
Giant Growth [S00 - Starter 2000]
Glory [MBP - Media Insert Promo]
Glory of Warfare [HOP - Planechase]
Goblin Hero [S00 - Starter 2000]
Goblin Offensive [HOP - Planechase]
Gold Myr [HOP - Planechase]
Grave Pact [HOP - Planechase]
Gravedigger [HOP - Planechase]
Great Furnace [HOP - Planechase]
Gruul Turf [HOP - Planechase]
Hearthfire Hobgoblin [HOP - Planechase]
Helldozer [HOP - Planechase]
Helm of Kaldra [MBP - Media Insert Promo]
Hero's Resolve [S00 - Starter 2000]
Hideous End [HOP - Planechase]
Hull Breach [HOP - Planechase]
Incremental Blight [HOP - Planechase]
Innocent Blood [HOP - Planechase]
Inspiration [S00 - Starter 2000]
Insurrection [HOP - Planechase]
Iron Myr [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Ivy Elemental [HOP - Planechase]
Keep Watch [HOP - Planechase]
Keldon Champion [HOP - Planechase]
Kor Sanctifiers [HOP - Planechase]
Laquatus's Champion [MBP - Media Insert Promo]
Leaden Myr [HOP - Planechase]
Leechridden Swamp [HOP - Planechase]
Lightning Dragon [MBP - Media Insert Promo]
Lightning Helix [HOP - Planechase]
Living Hive [HOP - Planechase]
Llanowar Elves [S00 - Starter 2000]
Lodestone Myr [HOP - Planechase]
Loxodon Warhammer [HOP - Planechase]
Mage Slayer [HOP - Planechase]
Mask of Memory [HOP - Planechase]
Master of Etherium [HOP - Planechase]
Merfolk of the Pearl Trident [S00 - Starter 2000]
Monstrous Hound [MBP - Media Insert Promo]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Myr Enforcer [HOP - Planechase]
Nefashu [HOP - Planechase]
Noxious Ghoul [HOP - Planechase]
Nuisance Engine [HOP - Planechase]
Oblivion Ring [HOP - Planechase]
Obsianus Golem [S00 - Starter 2000]
Orcish Oriflamme [S00 - Starter 2000]
OrderChaos [HOP - Planechase]
Orim's Thunder [HOP - Planechase]
Overtaker [MBP - Media Insert Promo]
Pentad Prism [HOP - Planechase]
Pentavus [HOP - Planechase]
Phyrexian Arena [HOP - Planechase]
Phyrexian Ghoul [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Prison Term [HOP - Planechase]
Prodigal Sorcerer [S00 - Starter 2000]
Profane Command [HOP - Planechase]
Pyrotechnics [HOP - Planechase]
Python [S00 - Starter 2000]
Questing Phelddagrif [MBP - Media Insert Promo]
Qumulox [HOP - Planechase]
Raging Kavu [MBP - Media Insert Promo]
Rampant Growth [HOP - Planechase]
Rathi Assassin [MBP - Media Insert Promo]
Reckless Charge [HOP - Planechase]
Relentless Assault [HOP - Planechase]
Relic of Progenitus [HOP - Planechase]
Revenant [MBP - Media Insert Promo]
Rockslide Elemental [HOP - Planechase]
Rod of Ruin [S00 - Starter 2000]
Rolling Thunder [HOP - Planechase]
Rorix Bladewing [HOP - Planechase]
Rotting Rats [HOP - Planechase]
Rumbling Slum [HOP - Planechase]
Ryusei, the Falling Star [MBP - Media Insert Promo]
Samite Healer [S00 - Starter 2000]
Sarcomite Myr [HOP - Planechase]
Savage Twister [HOP - Planechase]
Scathe Zombies [S00 - Starter 2000]
Search for Tomorrow [HOP - Planechase]
Seat of the Synod [HOP - Planechase]
Serum Tank [HOP - Planechase]
Sewers of Estark [MBP - Media Insert Promo]
Shepherd of Rot [HOP - Planechase]
Shield of Kaldra [MBP - Media Insert Promo]
Shivan Oasis [HOP - Planechase]
Shock [S00 - Starter 2000]
Silent Specter [MBP - Media Insert Promo]
Silver Myr [HOP - Planechase]
Silverglade Elemental [HOP - Planechase]
Skeleton Shard [HOP - Planechase]
Sludge Strider [HOP - Planechase]
Smokebraider [HOP - Planechase]
Soul Collector [MBP - Media Insert Promo]
Soul Net [S00 - Starter 2000]
Soul Warden [HOP - Planechase]
Soulless One [HOP - Planechase]
Spined Wurm [S00 - Starter 2000]
Stone Rain [S00 - Starter 2000]
Sunhome, Fortress of the Legion [HOP - Planechase]
Suntouched Myr [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Sword of Kaldra [MBP - Media Insert Promo]
Syphon Mind [HOP - Planechase]
Syphon Soul [HOP - Planechase]
Taurean Mauler [HOP - Planechase]
Terramorphic Expanse [HOP - Planechase]
Terror [S00 - Starter 2000]
Thirst for Knowledge [HOP - Planechase]
Tornado Elemental [HOP - Planechase]
Tree of Tales [HOP - Planechase]
Tribal Unity [HOP - Planechase]
Undead Warchief [HOP - Planechase]
Vault of Whispers [HOP - Planechase]
Vedalken Engineer [HOP - Planechase]
Venerable Monk [S00 - Starter 2000]
Verdant Force [HOP - Planechase]
WaxWane [ARC - Archenemy]
Whiplash Trap [HOP - Planechase]
Wind Drake [S00 - Starter 2000]
Withered Wretch [HOP - Planechase]
Wizard Replica [HOP - Planechase]
Academy at Tolaria West [HOP - Planechase]
Aretopolis [PC2 - Planechase 2012 Edition]
Birds of Paradise Avatar [VAN - Vanguard]
Birds of Paradise Avatar [VAN - Vanguard]
Chaotic AEther [PC2 - Planechase 2012 Edition]
Erhnam Djinn Avatar [VAN - Vanguard]
Erhnam Djinn Avatar [VAN - Vanguard]
Feeding Grounds [HOP - Planechase]
Fields of Summer [HOP - Planechase]
Goblin Warchief Avatar [VAN - Vanguard]
Goblin Warchief Avatar [VAN - Vanguard]
Goldmeadow [HOP - Planechase]
Grinning Demon Avatar [VAN - Vanguard]
Grinning Demon Avatar [VAN - Vanguard]
Horizon Boughs [HOP - Planechase]
Jaya Ballard Avatar [VAN - Vanguard]
Krosa [HOP - Planechase]
Lethe Lake [HOP - Planechase]
Llanowar [HOP - Planechase]
Mutual Epiphany [PC2 - Planechase 2012 Edition]
Panopticon [HOP - Planechase]
Planewide Disaster [PC2 - Planechase 2012 Edition]
Platinum Angel Avatar [VAN - Vanguard]
Platinum Angel Avatar [VAN - Vanguard]
Prodigal Sorcerer Avatar [VAN - Vanguard]
Prodigal Sorcerer Avatar [VAN - Vanguard]
Raven's Run [HOP - Planechase]
Rith, the Awakener Avatar [VAN - Vanguard]
Rith, the Awakener Avatar [VAN - Vanguard]
Royal Assassin Avatar [VAN - Vanguard]
Royal Assassin Avatar [VAN - Vanguard]
Serra Angel Avatar [VAN - Vanguard]
Serra Angel Avatar [VAN - Vanguard]
Takenuma [PC2 - Planechase 2012 Edition]
Talon Gates [PC2 - Planechase 2012 Edition]
The AEther Flues [HOP - Planechase]
The Fourth Sphere [HOP - Planechase]
The Great Forest [HOP - Planechase]
The Hippodrome [HOP - Planechase]
Tradewind Rider Avatar [VAN - Vanguard]
Tradewind Rider Avatar [VAN - Vanguard]
Trail of the Mage-Rings [PC2 - Planechase 2012 Edition]
Truga Jungle [PC2 - Planechase 2012 Edition]
Undercity Reaches [HOP - Planechase]
Velis Vel [HOP - Planechase]

Re: mtg-data.txt db faults =(

PostPosted: 09 Mar 2013, 05:53
by myk
I have a quick semi-related question: why is it that our set-specific LQ pics are on the cardforge server with base64-encoded names? Is this how we get them? Is this standard procedure?

Re: mtg-data.txt db faults =(

PostPosted: 09 Mar 2013, 06:26
by Max mtg
Chris H. wrote: 
I checked the listing and there appears to be 24 cards from 6th and 1 card form 8th (Rhox) that are missing.

The archive below contains HQ pics for these cards. They need to be run through the script/commands that will scale them down in size and saved at less than 100%. At that point they need to be added to the Starter 2000 cards folder at cardforge.
 
There is no Rhox in online db at gatherer: http://gatherer.wizards.com/Pages/Searc ... anced&set=[%22Starter+2000%22]

Rhox from 8ed can by no chance get into starter 2000 boosters, because the new card design was launched in 2002 only.
It is also present in S00 folder of hq pictures provided by CCGHQ.



About planechase - I hand to rename my PCH folder from CCGHQ download into HOP.
I personally don't like that 'hop' abbreviation, because didn't find any confirmation on the net of this being official edition code. Magic online for instance calls them PC1 (first planechase) and PC2 (for 2012)