mtg-data.txt db faults =(
Post MTG Forge Related Programming Questions Here
Moderators: timmermac, Agetian, friarsol, Blacksmith, KrazyTheFox, CCGHQ Admins
32 posts
• Page 2 of 3 • 1, 2, 3
Re: mtg-data.txt db faults =(
by moomarc » 09 Mar 2013, 08:37
I think Rob did the base64 encoding to limit direct traffic to the site by people searching by cardname. Keep in mind that when he started up Cardforge to host some backend, we didn't have unlimited bandwidth and there was also a lot of scrambling because at that time WotC had just sent Rares a new round of DMCA notices wanting to shut down the host at the time. I think that was another reason why we didn't want searches for WotC copyrighted material linking directly to the new host. Some of that saga can be caught up on here.myk wrote:I have a quick semi-related question: why is it that our set-specific LQ pics are on the cardforge server with base64-encoded names? Is this how we get them? Is this standard procedure?
-Marc
-

moomarc - Pixel Commander
- Posts: 2091
- Joined: 04 Jun 2010, 15:22
- Location: Johannesburg, South Africa
- Has thanked: 371 times
- Been thanked: 372 times
Re: mtg-data.txt db faults =(
by moomarc » 09 Mar 2013, 08:48
I've uploaded the standard cards for Planechase, just need to do the planes now. Should I upload the images in landscape format as they are when grabbing the hq images, or should I rotate the images to match the other cards. You have to read the card with your head tilted 90 degrees like with split cards for now, but the image is a decent size without having to resize your image panel and maybe at some point someone with the know-how could add some code that rotate's Plane cards in the command zone 90 degrees.Chris H. wrote:I attempted to download the new LQ card set pics that have been released to cardforge over the last year or so. This is the list of cards that as of today do not download.
- the list | Open
Akroma's Vengeance [HOP - Planechase]
Ancient Den [HOP - Planechase]
Arc Lightning [HOP - Planechase]
Arcbound Crusher [HOP - Planechase]
Arcbound Slith [HOP - Planechase]
Armored Pegasus [S00 - Starter 2000]
Arsenal Thresher [HOP - Planechase]
Ascendant Evincar [HOP - Planechase]
AssaultBattery [HOP - Planechase]
Avatar of Hope [MBP - Media Insert Promo]
Balefire Liege [HOP - Planechase]
Battlegate Mimic [HOP - Planechase]
Beacon of Unrest [HOP - Planechase]
Beast Hunt [HOP - Planechase]
Beast of Burden [MBP - Media Insert Promo]
Beseech the Queen [HOP - Planechase]
Blaze [HOP - Planechase]
Bog Imp [S00 - Starter 2000]
Bogardan Firefiend [HOP - Planechase]
Bogardan Rager [HOP - Planechase]
Boros Garrison [HOP - Planechase]
Boros Guildmage [HOP - Planechase]
Boros Signet [HOP - Planechase]
Boros Swiftblade [HOP - Planechase]
Bosh, Iron Golem [HOP - Planechase]
Branching Bolt [HOP - Planechase]
Briarhorn [HOP - Planechase]
Broodstar [HOP - Planechase]
Browbeat [HOP - Planechase]
Bull Cerodon [HOP - Planechase]
Cabal Coffers [HOP - Planechase]
Cadaverous Knight [HOP - Planechase]
Cerodon Yearling [HOP - Planechase]
Cinder Elemental [HOP - Planechase]
Coercion [S00 - Starter 2000]
Cone of Flame [HOP - Planechase]
Congregate [HOP - Planechase]
Consume Spirit [HOP - Planechase]
Copper Myr [HOP - Planechase]
Corpse Harvester [HOP - Planechase]
Counterspell [S00 - Starter 2000]
Cranial Plating [HOP - Planechase]
Cruel Revival [HOP - Planechase]
Dark Ritual [HOP - Planechase]
Darksteel Forge [HOP - Planechase]
Death Baron [HOP - Planechase]
Dirtcowl Wurm [MBP - Media Insert Promo]
Disenchant [S00 - Starter 2000]
Door to Nothingness [HOP - Planechase]
Double Cleave [HOP - Planechase]
Dregscape Zombie [HOP - Planechase]
Drudge Skeletons [S00 - Starter 2000]
Duergar Hedge-Mage [HOP - Planechase]
Etched Oracle [HOP - Planechase]
Explosive Vegetation [HOP - Planechase]
Fabricate [HOP - Planechase]
False Prophet [MBP - Media Insert Promo]
Feral Throwback [MBP - Media Insert Promo]
Fertile Ground [HOP - Planechase]
Fertilid [HOP - Planechase]
Festering Goblin [HOP - Planechase]
Fires of Yavimaya [HOP - Planechase]
Flame Spirit [S00 - Starter 2000]
Flamekin Harbinger [HOP - Planechase]
Flametongue Kavu [HOP - Planechase]
Flight [S00 - Starter 2000]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forgotten Ancient [HOP - Planechase]
Fungal Shambler [MBP - Media Insert Promo]
Furnace of Rath [HOP - Planechase]
Giant Badger [MBP - Media Insert Promo]
Giant Growth [S00 - Starter 2000]
Glory [MBP - Media Insert Promo]
Glory of Warfare [HOP - Planechase]
Goblin Hero [S00 - Starter 2000]
Goblin Offensive [HOP - Planechase]
Gold Myr [HOP - Planechase]
Grave Pact [HOP - Planechase]
Gravedigger [HOP - Planechase]
Great Furnace [HOP - Planechase]
Gruul Turf [HOP - Planechase]
Hearthfire Hobgoblin [HOP - Planechase]
Helldozer [HOP - Planechase]
Helm of Kaldra [MBP - Media Insert Promo]
Hero's Resolve [S00 - Starter 2000]
Hideous End [HOP - Planechase]
Hull Breach [HOP - Planechase]
Incremental Blight [HOP - Planechase]
Innocent Blood [HOP - Planechase]
Inspiration [S00 - Starter 2000]
Insurrection [HOP - Planechase]
Iron Myr [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Ivy Elemental [HOP - Planechase]
Keep Watch [HOP - Planechase]
Keldon Champion [HOP - Planechase]
Kor Sanctifiers [HOP - Planechase]
Laquatus's Champion [MBP - Media Insert Promo]
Leaden Myr [HOP - Planechase]
Leechridden Swamp [HOP - Planechase]
Lightning Dragon [MBP - Media Insert Promo]
Lightning Helix [HOP - Planechase]
Living Hive [HOP - Planechase]
Llanowar Elves [S00 - Starter 2000]
Lodestone Myr [HOP - Planechase]
Loxodon Warhammer [HOP - Planechase]
Mage Slayer [HOP - Planechase]
Mask of Memory [HOP - Planechase]
Master of Etherium [HOP - Planechase]
Merfolk of the Pearl Trident [S00 - Starter 2000]
Monstrous Hound [MBP - Media Insert Promo]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Myr Enforcer [HOP - Planechase]
Nefashu [HOP - Planechase]
Noxious Ghoul [HOP - Planechase]
Nuisance Engine [HOP - Planechase]
Oblivion Ring [HOP - Planechase]
Obsianus Golem [S00 - Starter 2000]
Orcish Oriflamme [S00 - Starter 2000]
OrderChaos [HOP - Planechase]
Orim's Thunder [HOP - Planechase]
Overtaker [MBP - Media Insert Promo]
Pentad Prism [HOP - Planechase]
Pentavus [HOP - Planechase]
Phyrexian Arena [HOP - Planechase]
Phyrexian Ghoul [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Prison Term [HOP - Planechase]
Prodigal Sorcerer [S00 - Starter 2000]
Profane Command [HOP - Planechase]
Pyrotechnics [HOP - Planechase]
Python [S00 - Starter 2000]
Questing Phelddagrif [MBP - Media Insert Promo]
Qumulox [HOP - Planechase]
Raging Kavu [MBP - Media Insert Promo]
Rampant Growth [HOP - Planechase]
Rathi Assassin [MBP - Media Insert Promo]
Reckless Charge [HOP - Planechase]
Relentless Assault [HOP - Planechase]
Relic of Progenitus [HOP - Planechase]
Revenant [MBP - Media Insert Promo]
Rockslide Elemental [HOP - Planechase]
Rod of Ruin [S00 - Starter 2000]
Rolling Thunder [HOP - Planechase]
Rorix Bladewing [HOP - Planechase]
Rotting Rats [HOP - Planechase]
Rumbling Slum [HOP - Planechase]
Ryusei, the Falling Star [MBP - Media Insert Promo]
Samite Healer [S00 - Starter 2000]
Sarcomite Myr [HOP - Planechase]
Savage Twister [HOP - Planechase]
Scathe Zombies [S00 - Starter 2000]
Search for Tomorrow [HOP - Planechase]
Seat of the Synod [HOP - Planechase]
Serum Tank [HOP - Planechase]
Sewers of Estark [MBP - Media Insert Promo]
Shepherd of Rot [HOP - Planechase]
Shield of Kaldra [MBP - Media Insert Promo]
Shivan Oasis [HOP - Planechase]
Shock [S00 - Starter 2000]
Silent Specter [MBP - Media Insert Promo]
Silver Myr [HOP - Planechase]
Silverglade Elemental [HOP - Planechase]
Skeleton Shard [HOP - Planechase]
Sludge Strider [HOP - Planechase]
Smokebraider [HOP - Planechase]
Soul Collector [MBP - Media Insert Promo]
Soul Net [S00 - Starter 2000]
Soul Warden [HOP - Planechase]
Soulless One [HOP - Planechase]
Spined Wurm [S00 - Starter 2000]
Stone Rain [S00 - Starter 2000]
Sunhome, Fortress of the Legion [HOP - Planechase]
Suntouched Myr [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Sword of Kaldra [MBP - Media Insert Promo]
Syphon Mind [HOP - Planechase]
Syphon Soul [HOP - Planechase]
Taurean Mauler [HOP - Planechase]
Terramorphic Expanse [HOP - Planechase]
Terror [S00 - Starter 2000]
Thirst for Knowledge [HOP - Planechase]
Tornado Elemental [HOP - Planechase]
Tree of Tales [HOP - Planechase]
Tribal Unity [HOP - Planechase]
Undead Warchief [HOP - Planechase]
Vault of Whispers [HOP - Planechase]
Vedalken Engineer [HOP - Planechase]
Venerable Monk [S00 - Starter 2000]
Verdant Force [HOP - Planechase]
WaxWane [ARC - Archenemy]
Whiplash Trap [HOP - Planechase]
Wind Drake [S00 - Starter 2000]
Withered Wretch [HOP - Planechase]
Wizard Replica [HOP - Planechase]
Academy at Tolaria West [HOP - Planechase]
Aretopolis [PC2 - Planechase 2012 Edition]
Birds of Paradise Avatar [VAN - Vanguard]
Birds of Paradise Avatar [VAN - Vanguard]
Chaotic AEther [PC2 - Planechase 2012 Edition]
Erhnam Djinn Avatar [VAN - Vanguard]
Erhnam Djinn Avatar [VAN - Vanguard]
Feeding Grounds [HOP - Planechase]
Fields of Summer [HOP - Planechase]
Goblin Warchief Avatar [VAN - Vanguard]
Goblin Warchief Avatar [VAN - Vanguard]
Goldmeadow [HOP - Planechase]
Grinning Demon Avatar [VAN - Vanguard]
Grinning Demon Avatar [VAN - Vanguard]
Horizon Boughs [HOP - Planechase]
Jaya Ballard Avatar [VAN - Vanguard]
Krosa [HOP - Planechase]
Lethe Lake [HOP - Planechase]
Llanowar [HOP - Planechase]
Mutual Epiphany [PC2 - Planechase 2012 Edition]
Panopticon [HOP - Planechase]
Planewide Disaster [PC2 - Planechase 2012 Edition]
Platinum Angel Avatar [VAN - Vanguard]
Platinum Angel Avatar [VAN - Vanguard]
Prodigal Sorcerer Avatar [VAN - Vanguard]
Prodigal Sorcerer Avatar [VAN - Vanguard]
Raven's Run [HOP - Planechase]
Rith, the Awakener Avatar [VAN - Vanguard]
Rith, the Awakener Avatar [VAN - Vanguard]
Royal Assassin Avatar [VAN - Vanguard]
Royal Assassin Avatar [VAN - Vanguard]
Serra Angel Avatar [VAN - Vanguard]
Serra Angel Avatar [VAN - Vanguard]
Takenuma [PC2 - Planechase 2012 Edition]
Talon Gates [PC2 - Planechase 2012 Edition]
The AEther Flues [HOP - Planechase]
The Fourth Sphere [HOP - Planechase]
The Great Forest [HOP - Planechase]
The Hippodrome [HOP - Planechase]
Tradewind Rider Avatar [VAN - Vanguard]
Tradewind Rider Avatar [VAN - Vanguard]
Trail of the Mage-Rings [PC2 - Planechase 2012 Edition]
Truga Jungle [PC2 - Planechase 2012 Edition]
Undercity Reaches [HOP - Planechase]
Velis Vel [HOP - Planechase]
Any preferences from the rest of you?
-Marc
-

moomarc - Pixel Commander
- Posts: 2091
- Joined: 04 Jun 2010, 15:22
- Location: Johannesburg, South Africa
- Has thanked: 371 times
- Been thanked: 372 times
Re: mtg-data.txt db faults =(
by Chris H. » 09 Mar 2013, 13:03
Max mtg wrote:There is no Rhox in online db at gatherer: http://gatherer.wizards.com/Pages/Searc ... anced&set=[%22Starter+2000%22]
Rhox from 8ed can by no chance get into starter 2000 boosters, because the new card design was launched in 2002 only.
It is also present in S00 folder of hq pictures provided by CCGHQ.
Thanks Max.
I guess that the list at http://www.wizards.com/magic/generic/cardlists/s2k_checklist.txt just goes to show that even the people at the http://www.wizards.com site can make mistakes at times.
-

Chris H. - Forge Moderator
- Posts: 6320
- Joined: 04 Nov 2008, 12:11
- Location: Mac OS X Yosemite
- Has thanked: 644 times
- Been thanked: 643 times
Re: mtg-data.txt db faults =(
by friarsol » 09 Mar 2013, 14:37
According to the Wikipedia page, they have the abbreviation as HOP too, And Arch has said in the past those abbreviations come from Gatherer.Max mtg wrote:About planechase - I hand to rename my PCH folder from CCGHQ download into HOP.
I personally don't like that 'hop' abbreviation, because didn't find any confirmation on the net of this being official edition code. Magic online for instance calls them PC1 (first planechase) and PC2 (for 2012)
http://en.wikipedia.org/wiki/List_of_Ma ... ering_sets
But I also think this is a dumb abbreviation and prefer our old abbreviation.
I think following what Gatherer abbreviations for sets to is a bad idea anyway, since it could lead to the issue where we're forced to create an inaccessible folder in Windows. (this is why we don't have CON as the Conflux folder name)
- friarsol
- Global Moderator
- Posts: 7593
- Joined: 15 May 2010, 04:20
- Has thanked: 243 times
- Been thanked: 965 times
Re: mtg-data.txt db faults =(
by friarsol » 09 Mar 2013, 14:42
It definitely wouldn't have been the 8th edition Rhox, but it looks like it was the Nemesis Rhox. Here's an article: https://www.wizards.com/Magic/Magazine/ ... arcana/390Chris H. wrote:Max mtg wrote:There is no Rhox in online db at gatherer: http://gatherer.wizards.com/Pages/Searc ... anced&set=[%22Starter+2000%22]
Rhox from 8ed can by no chance get into starter 2000 boosters, because the new card design was launched in 2002 only.
It is also present in S00 folder of hq pictures provided by CCGHQ.
Thanks Max.
I guess that the list at http://www.wizards.com/magic/generic/cardlists/s2k_checklist.txt just goes to show that even the people at the http://www.wizards.com site can make mistakes at times.
Not sure why he doesn't appear in gatherer, maybe because he was a promo card? And not actually in the decks?
- friarsol
- Global Moderator
- Posts: 7593
- Joined: 15 May 2010, 04:20
- Has thanked: 243 times
- Been thanked: 965 times
Re: mtg-data.txt db faults =(
by myk » 09 Mar 2013, 15:20
I am actually doing some work on the res/pics/ folder layout in my branch. I was experimenting with making our layout match MWS folder layout so we could simplify the file lookup algorithms and unify the filename generation algorithms. Is this a good idea? I have to write migration code to move the files from <progDir>/res/pics/ to <cacheDir>/pics/cards/ anyway, so it seemed like an opportune time to make changes like this.friarsol wrote:I think following what Gatherer abbreviations for sets to is a bad idea anyway, since it could lead to the issue where we're forced to create an inaccessible folder in Windows. (this is why we don't have CON as the Conflux folder name)
@marc: the filenames in the new fpics/HOP/ directory are not base64-encoded, so they're not quite accessible yet.
- myk
- Posts: 439
- Joined: 17 Jan 2013, 02:39
- Location: California
- Has thanked: 38 times
- Been thanked: 57 times
Re: mtg-data.txt db faults =(
by friarsol » 09 Mar 2013, 15:43
We don't really need duplicate files here, we could just have a symlink for the HOP folder to point to the old Planechase folder.myk wrote:@marc: the filenames in the new fpics/HOP/ directory are not base64-encoded, so they're not quite accessible yet.
- friarsol
- Global Moderator
- Posts: 7593
- Joined: 15 May 2010, 04:20
- Has thanked: 243 times
- Been thanked: 965 times
Re: mtg-data.txt db faults =(
by moomarc » 09 Mar 2013, 16:18
Oops, Hadn't realised that there was already a PLC folder. I can easily just rename that to HOP if that would make life easier. Although I might just stick to the new ones I uploaded and just encode them. The quality is a bit better without pushing the file size too high and the planes are decently cropped to avoid white corners from appearing. So are we using HOP or PLC as the extension?friarsol wrote:We don't really need duplicate files here, we could just have a symlink for the HOP folder to point to the old Planechase folder.myk wrote:@marc: the filenames in the new fpics/HOP/ directory are not base64-encoded, so they're not quite accessible yet.
-Marc
-

moomarc - Pixel Commander
- Posts: 2091
- Joined: 04 Jun 2010, 15:22
- Location: Johannesburg, South Africa
- Has thanked: 371 times
- Been thanked: 372 times
Re: mtg-data.txt db faults =(
by myk » 09 Mar 2013, 16:23
PLC is the Planar Chaos expansion, isn't it? At least according to our setdata.txt:
- Code: Select all
$ grep PLC setdata.txt
Code2:PLC|Code3:PLC|Type:Expansion|Name:Planar Chaos
$ grep HOP setdata.txt
Code2:HOP|Code3:HOP|Type:Other|Name:Planechase
- myk
- Posts: 439
- Joined: 17 Jan 2013, 02:39
- Location: California
- Has thanked: 38 times
- Been thanked: 57 times
Re: mtg-data.txt db faults =(
by moomarc » 09 Mar 2013, 16:35
Oh rightmyk wrote:PLC is the Planar Chaos expansion, isn't it? At least according to our setdata.txt:
- Code: Select all
$ grep PLC setdata.txt
Code2:PLC|Code3:PLC|Type:Expansion|Name:Planar Chaos
$ grep HOP setdata.txt
Code2:HOP|Code3:HOP|Type:Other|Name:Planechase
I knew that. So which old Planechase folder was the good friar referring to then? There's no PCH folder on Cardforge, so maybe he was just referring to a local folder named something other than HOP? Could you clarify please Sol.On a side note, is it not worth adding PLC as Code:2 or as an alias for HOP in SetData. Then if someone does bring in the folder named that, they don't have to rename it?
-Marc
-

moomarc - Pixel Commander
- Posts: 2091
- Joined: 04 Jun 2010, 15:22
- Location: Johannesburg, South Africa
- Has thanked: 371 times
- Been thanked: 372 times
Re: mtg-data.txt db faults =(
by myk » 09 Mar 2013, 16:52
+1 on the alias. Also, what is the correct name for Assault // Battery's pic? By "correct", I mean MWS-compliant. It's on the server as base64("Assault Battery.full.jpg"), but our code looks for it at base64("AssaultBattery.full.jpg").
Last edited by myk on 09 Mar 2013, 16:59, edited 1 time in total.
- myk
- Posts: 439
- Joined: 17 Jan 2013, 02:39
- Location: California
- Has thanked: 38 times
- Been thanked: 57 times
Re: mtg-data.txt db faults =(
by Agetian » 09 Mar 2013, 16:59
@ myk: All other split cards follow the pattern LeftsplitRightsplit.full.jpg, as in FireIce.full.jpg, NightDay.full.jpg, etc., so I assume it should be AssaultBattery.full.jpg.
- Agetian
- Agetian
- Agetian
- Programmer
- Posts: 3490
- Joined: 14 Mar 2011, 05:58
- Has thanked: 684 times
- Been thanked: 572 times
Re: mtg-data.txt db faults =(
by myk » 09 Mar 2013, 17:03
confirmed -- I just checked in the HQ pics torrent:
Edit2: The issue for the vanguard pics seems to be that those cards have SetInfo:VAN Special x2, so we look for cardname1.full.jpg and cardname2.full.jpg, but only cardname.full.jpg appears on the server.
- Code: Select all
$ for fname in *; do unzip -l $fname; done | grep Assault.*Battery
40808 12-24-1996 23:32 IN/AssaultBattery.full.jpg
200606 12-24-1996 23:32 TSB/AssaultBattery.full.jpg
Edit2: The issue for the vanguard pics seems to be that those cards have SetInfo:VAN Special x2, so we look for cardname1.full.jpg and cardname2.full.jpg, but only cardname.full.jpg appears on the server.
- myk
- Posts: 439
- Joined: 17 Jan 2013, 02:39
- Location: California
- Has thanked: 38 times
- Been thanked: 57 times
Re: mtg-data.txt db faults =(
by Max mtg » 09 Mar 2013, 19:17
So, if we do agree to use PCH set code for planechase, should patch the python script settings like this:
- Code: Select all
Index: res/mtgdata-sets-to-forge.txt
===================================================================
--- res/mtgdata-sets-to-forge.txt (revision 20198)
+++ res/mtgdata-sets-to-forge.txt (working copy)
@@ -54,7 +54,7 @@
GU ULG # Urza's Legacy
===H09 # Premium Deck Series: Slivers
HM HML # Homelands
-===HOP # Planechase
+HOP PCH # Planechase
IA ICE # Ice Age
IN INV # Invasion
===ISD # Innistrad
- Code: Select all
Code2:PCH|Code3:PCH|Type:Other|Name:Planechase|Alias:HOP
Single class for single responsibility.
- Max mtg
- Programmer
- Posts: 1997
- Joined: 02 Jul 2011, 14:26
- Has thanked: 173 times
- Been thanked: 334 times
Re: mtg-data.txt db faults =(
by friarsol » 12 Mar 2013, 19:21
Looks like arch just posted a fix for mtg-data file including split cards
viewtopic.php?f=27&t=1347#p112230
I won't be able to update the file till tomorrow night sometime, so if someone can upload, that'd be great.
viewtopic.php?f=27&t=1347#p112230
I won't be able to update the file till tomorrow night sometime, so if someone can upload, that'd be great.
- friarsol
- Global Moderator
- Posts: 7593
- Joined: 15 May 2010, 04:20
- Has thanked: 243 times
- Been thanked: 965 times
32 posts
• Page 2 of 3 • 1, 2, 3
Who is online
Users browsing this forum: No registered users and 16 guests