It is currently 02 Nov 2025, 10:46
   
Text Size

mtg-data.txt db faults =(

Post MTG Forge Related Programming Questions Here

Moderators: timmermac, Agetian, friarsol, Blacksmith, KrazyTheFox, CCGHQ Admins

Re: mtg-data.txt db faults =(

Postby moomarc » 09 Mar 2013, 08:37

myk wrote:I have a quick semi-related question: why is it that our set-specific LQ pics are on the cardforge server with base64-encoded names? Is this how we get them? Is this standard procedure?
I think Rob did the base64 encoding to limit direct traffic to the site by people searching by cardname. Keep in mind that when he started up Cardforge to host some backend, we didn't have unlimited bandwidth and there was also a lot of scrambling because at that time WotC had just sent Rares a new round of DMCA notices wanting to shut down the host at the time. I think that was another reason why we didn't want searches for WotC copyrighted material linking directly to the new host. Some of that saga can be caught up on here.
-Marc
User avatar
moomarc
Pixel Commander
 
Posts: 2091
Joined: 04 Jun 2010, 15:22
Location: Johannesburg, South Africa
Has thanked: 371 times
Been thanked: 372 times

Re: mtg-data.txt db faults =(

Postby moomarc » 09 Mar 2013, 08:48

Chris H. wrote:I attempted to download the new LQ card set pics that have been released to cardforge over the last year or so. This is the list of cards that as of today do not download.

the list | Open
Akroma's Vengeance [HOP - Planechase]
Ancient Den [HOP - Planechase]
Arc Lightning [HOP - Planechase]
Arcbound Crusher [HOP - Planechase]
Arcbound Slith [HOP - Planechase]
Armored Pegasus [S00 - Starter 2000]
Arsenal Thresher [HOP - Planechase]
Ascendant Evincar [HOP - Planechase]
AssaultBattery [HOP - Planechase]
Avatar of Hope [MBP - Media Insert Promo]
Balefire Liege [HOP - Planechase]
Battlegate Mimic [HOP - Planechase]
Beacon of Unrest [HOP - Planechase]
Beast Hunt [HOP - Planechase]
Beast of Burden [MBP - Media Insert Promo]
Beseech the Queen [HOP - Planechase]
Blaze [HOP - Planechase]
Bog Imp [S00 - Starter 2000]
Bogardan Firefiend [HOP - Planechase]
Bogardan Rager [HOP - Planechase]
Boros Garrison [HOP - Planechase]
Boros Guildmage [HOP - Planechase]
Boros Signet [HOP - Planechase]
Boros Swiftblade [HOP - Planechase]
Bosh, Iron Golem [HOP - Planechase]
Branching Bolt [HOP - Planechase]
Briarhorn [HOP - Planechase]
Broodstar [HOP - Planechase]
Browbeat [HOP - Planechase]
Bull Cerodon [HOP - Planechase]
Cabal Coffers [HOP - Planechase]
Cadaverous Knight [HOP - Planechase]
Cerodon Yearling [HOP - Planechase]
Cinder Elemental [HOP - Planechase]
Coercion [S00 - Starter 2000]
Cone of Flame [HOP - Planechase]
Congregate [HOP - Planechase]
Consume Spirit [HOP - Planechase]
Copper Myr [HOP - Planechase]
Corpse Harvester [HOP - Planechase]
Counterspell [S00 - Starter 2000]
Cranial Plating [HOP - Planechase]
Cruel Revival [HOP - Planechase]
Dark Ritual [HOP - Planechase]
Darksteel Forge [HOP - Planechase]
Death Baron [HOP - Planechase]
Dirtcowl Wurm [MBP - Media Insert Promo]
Disenchant [S00 - Starter 2000]
Door to Nothingness [HOP - Planechase]
Double Cleave [HOP - Planechase]
Dregscape Zombie [HOP - Planechase]
Drudge Skeletons [S00 - Starter 2000]
Duergar Hedge-Mage [HOP - Planechase]
Etched Oracle [HOP - Planechase]
Explosive Vegetation [HOP - Planechase]
Fabricate [HOP - Planechase]
False Prophet [MBP - Media Insert Promo]
Feral Throwback [MBP - Media Insert Promo]
Fertile Ground [HOP - Planechase]
Fertilid [HOP - Planechase]
Festering Goblin [HOP - Planechase]
Fires of Yavimaya [HOP - Planechase]
Flame Spirit [S00 - Starter 2000]
Flamekin Harbinger [HOP - Planechase]
Flametongue Kavu [HOP - Planechase]
Flight [S00 - Starter 2000]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forest [HOP - Planechase]
Forgotten Ancient [HOP - Planechase]
Fungal Shambler [MBP - Media Insert Promo]
Furnace of Rath [HOP - Planechase]
Giant Badger [MBP - Media Insert Promo]
Giant Growth [S00 - Starter 2000]
Glory [MBP - Media Insert Promo]
Glory of Warfare [HOP - Planechase]
Goblin Hero [S00 - Starter 2000]
Goblin Offensive [HOP - Planechase]
Gold Myr [HOP - Planechase]
Grave Pact [HOP - Planechase]
Gravedigger [HOP - Planechase]
Great Furnace [HOP - Planechase]
Gruul Turf [HOP - Planechase]
Hearthfire Hobgoblin [HOP - Planechase]
Helldozer [HOP - Planechase]
Helm of Kaldra [MBP - Media Insert Promo]
Hero's Resolve [S00 - Starter 2000]
Hideous End [HOP - Planechase]
Hull Breach [HOP - Planechase]
Incremental Blight [HOP - Planechase]
Innocent Blood [HOP - Planechase]
Inspiration [S00 - Starter 2000]
Insurrection [HOP - Planechase]
Iron Myr [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Island [HOP - Planechase]
Ivy Elemental [HOP - Planechase]
Keep Watch [HOP - Planechase]
Keldon Champion [HOP - Planechase]
Kor Sanctifiers [HOP - Planechase]
Laquatus's Champion [MBP - Media Insert Promo]
Leaden Myr [HOP - Planechase]
Leechridden Swamp [HOP - Planechase]
Lightning Dragon [MBP - Media Insert Promo]
Lightning Helix [HOP - Planechase]
Living Hive [HOP - Planechase]
Llanowar Elves [S00 - Starter 2000]
Lodestone Myr [HOP - Planechase]
Loxodon Warhammer [HOP - Planechase]
Mage Slayer [HOP - Planechase]
Mask of Memory [HOP - Planechase]
Master of Etherium [HOP - Planechase]
Merfolk of the Pearl Trident [S00 - Starter 2000]
Monstrous Hound [MBP - Media Insert Promo]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Mountain [HOP - Planechase]
Myr Enforcer [HOP - Planechase]
Nefashu [HOP - Planechase]
Noxious Ghoul [HOP - Planechase]
Nuisance Engine [HOP - Planechase]
Oblivion Ring [HOP - Planechase]
Obsianus Golem [S00 - Starter 2000]
Orcish Oriflamme [S00 - Starter 2000]
OrderChaos [HOP - Planechase]
Orim's Thunder [HOP - Planechase]
Overtaker [MBP - Media Insert Promo]
Pentad Prism [HOP - Planechase]
Pentavus [HOP - Planechase]
Phyrexian Arena [HOP - Planechase]
Phyrexian Ghoul [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Plains [HOP - Planechase]
Prison Term [HOP - Planechase]
Prodigal Sorcerer [S00 - Starter 2000]
Profane Command [HOP - Planechase]
Pyrotechnics [HOP - Planechase]
Python [S00 - Starter 2000]
Questing Phelddagrif [MBP - Media Insert Promo]
Qumulox [HOP - Planechase]
Raging Kavu [MBP - Media Insert Promo]
Rampant Growth [HOP - Planechase]
Rathi Assassin [MBP - Media Insert Promo]
Reckless Charge [HOP - Planechase]
Relentless Assault [HOP - Planechase]
Relic of Progenitus [HOP - Planechase]
Revenant [MBP - Media Insert Promo]
Rockslide Elemental [HOP - Planechase]
Rod of Ruin [S00 - Starter 2000]
Rolling Thunder [HOP - Planechase]
Rorix Bladewing [HOP - Planechase]
Rotting Rats [HOP - Planechase]
Rumbling Slum [HOP - Planechase]
Ryusei, the Falling Star [MBP - Media Insert Promo]
Samite Healer [S00 - Starter 2000]
Sarcomite Myr [HOP - Planechase]
Savage Twister [HOP - Planechase]
Scathe Zombies [S00 - Starter 2000]
Search for Tomorrow [HOP - Planechase]
Seat of the Synod [HOP - Planechase]
Serum Tank [HOP - Planechase]
Sewers of Estark [MBP - Media Insert Promo]
Shepherd of Rot [HOP - Planechase]
Shield of Kaldra [MBP - Media Insert Promo]
Shivan Oasis [HOP - Planechase]
Shock [S00 - Starter 2000]
Silent Specter [MBP - Media Insert Promo]
Silver Myr [HOP - Planechase]
Silverglade Elemental [HOP - Planechase]
Skeleton Shard [HOP - Planechase]
Sludge Strider [HOP - Planechase]
Smokebraider [HOP - Planechase]
Soul Collector [MBP - Media Insert Promo]
Soul Net [S00 - Starter 2000]
Soul Warden [HOP - Planechase]
Soulless One [HOP - Planechase]
Spined Wurm [S00 - Starter 2000]
Stone Rain [S00 - Starter 2000]
Sunhome, Fortress of the Legion [HOP - Planechase]
Suntouched Myr [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Swamp [HOP - Planechase]
Sword of Kaldra [MBP - Media Insert Promo]
Syphon Mind [HOP - Planechase]
Syphon Soul [HOP - Planechase]
Taurean Mauler [HOP - Planechase]
Terramorphic Expanse [HOP - Planechase]
Terror [S00 - Starter 2000]
Thirst for Knowledge [HOP - Planechase]
Tornado Elemental [HOP - Planechase]
Tree of Tales [HOP - Planechase]
Tribal Unity [HOP - Planechase]
Undead Warchief [HOP - Planechase]
Vault of Whispers [HOP - Planechase]
Vedalken Engineer [HOP - Planechase]
Venerable Monk [S00 - Starter 2000]
Verdant Force [HOP - Planechase]
WaxWane [ARC - Archenemy]
Whiplash Trap [HOP - Planechase]
Wind Drake [S00 - Starter 2000]
Withered Wretch [HOP - Planechase]
Wizard Replica [HOP - Planechase]
Academy at Tolaria West [HOP - Planechase]
Aretopolis [PC2 - Planechase 2012 Edition]
Birds of Paradise Avatar [VAN - Vanguard]
Birds of Paradise Avatar [VAN - Vanguard]
Chaotic AEther [PC2 - Planechase 2012 Edition]
Erhnam Djinn Avatar [VAN - Vanguard]
Erhnam Djinn Avatar [VAN - Vanguard]
Feeding Grounds [HOP - Planechase]
Fields of Summer [HOP - Planechase]
Goblin Warchief Avatar [VAN - Vanguard]
Goblin Warchief Avatar [VAN - Vanguard]
Goldmeadow [HOP - Planechase]
Grinning Demon Avatar [VAN - Vanguard]
Grinning Demon Avatar [VAN - Vanguard]
Horizon Boughs [HOP - Planechase]
Jaya Ballard Avatar [VAN - Vanguard]
Krosa [HOP - Planechase]
Lethe Lake [HOP - Planechase]
Llanowar [HOP - Planechase]
Mutual Epiphany [PC2 - Planechase 2012 Edition]
Panopticon [HOP - Planechase]
Planewide Disaster [PC2 - Planechase 2012 Edition]
Platinum Angel Avatar [VAN - Vanguard]
Platinum Angel Avatar [VAN - Vanguard]
Prodigal Sorcerer Avatar [VAN - Vanguard]
Prodigal Sorcerer Avatar [VAN - Vanguard]
Raven's Run [HOP - Planechase]
Rith, the Awakener Avatar [VAN - Vanguard]
Rith, the Awakener Avatar [VAN - Vanguard]
Royal Assassin Avatar [VAN - Vanguard]
Royal Assassin Avatar [VAN - Vanguard]
Serra Angel Avatar [VAN - Vanguard]
Serra Angel Avatar [VAN - Vanguard]
Takenuma [PC2 - Planechase 2012 Edition]
Talon Gates [PC2 - Planechase 2012 Edition]
The AEther Flues [HOP - Planechase]
The Fourth Sphere [HOP - Planechase]
The Great Forest [HOP - Planechase]
The Hippodrome [HOP - Planechase]
Tradewind Rider Avatar [VAN - Vanguard]
Tradewind Rider Avatar [VAN - Vanguard]
Trail of the Mage-Rings [PC2 - Planechase 2012 Edition]
Truga Jungle [PC2 - Planechase 2012 Edition]
Undercity Reaches [HOP - Planechase]
Velis Vel [HOP - Planechase]
I've uploaded the standard cards for Planechase, just need to do the planes now. Should I upload the images in landscape format as they are when grabbing the hq images, or should I rotate the images to match the other cards. You have to read the card with your head tilted 90 degrees like with split cards for now, but the image is a decent size without having to resize your image panel and maybe at some point someone with the know-how could add some code that rotate's Plane cards in the command zone 90 degrees.

Any preferences from the rest of you?
-Marc
User avatar
moomarc
Pixel Commander
 
Posts: 2091
Joined: 04 Jun 2010, 15:22
Location: Johannesburg, South Africa
Has thanked: 371 times
Been thanked: 372 times

Re: mtg-data.txt db faults =(

Postby Chris H. » 09 Mar 2013, 13:03

Max mtg wrote:There is no Rhox in online db at gatherer: http://gatherer.wizards.com/Pages/Searc ... anced&set=[%22Starter+2000%22]

Rhox from 8ed can by no chance get into starter 2000 boosters, because the new card design was launched in 2002 only.
It is also present in S00 folder of hq pictures provided by CCGHQ.
 
Thanks Max.

I guess that the list at http://www.wizards.com/magic/generic/cardlists/s2k_checklist.txt just goes to show that even the people at the http://www.wizards.com site can make mistakes at times. :lol:
User avatar
Chris H.
Forge Moderator
 
Posts: 6320
Joined: 04 Nov 2008, 12:11
Location: Mac OS X Yosemite
Has thanked: 644 times
Been thanked: 643 times

Re: mtg-data.txt db faults =(

Postby friarsol » 09 Mar 2013, 14:37

Max mtg wrote:About planechase - I hand to rename my PCH folder from CCGHQ download into HOP.
I personally don't like that 'hop' abbreviation, because didn't find any confirmation on the net of this being official edition code. Magic online for instance calls them PC1 (first planechase) and PC2 (for 2012)
According to the Wikipedia page, they have the abbreviation as HOP too, And Arch has said in the past those abbreviations come from Gatherer.

http://en.wikipedia.org/wiki/List_of_Ma ... ering_sets

But I also think this is a dumb abbreviation and prefer our old abbreviation.

I think following what Gatherer abbreviations for sets to is a bad idea anyway, since it could lead to the issue where we're forced to create an inaccessible folder in Windows. (this is why we don't have CON as the Conflux folder name)
friarsol
Global Moderator
 
Posts: 7593
Joined: 15 May 2010, 04:20
Has thanked: 243 times
Been thanked: 965 times

Re: mtg-data.txt db faults =(

Postby friarsol » 09 Mar 2013, 14:42

Chris H. wrote:
Max mtg wrote:There is no Rhox in online db at gatherer: http://gatherer.wizards.com/Pages/Searc ... anced&set=[%22Starter+2000%22]

Rhox from 8ed can by no chance get into starter 2000 boosters, because the new card design was launched in 2002 only.
It is also present in S00 folder of hq pictures provided by CCGHQ.
 
Thanks Max.

I guess that the list at http://www.wizards.com/magic/generic/cardlists/s2k_checklist.txt just goes to show that even the people at the http://www.wizards.com site can make mistakes at times. :lol:
It definitely wouldn't have been the 8th edition Rhox, but it looks like it was the Nemesis Rhox. Here's an article: https://www.wizards.com/Magic/Magazine/ ... arcana/390

Not sure why he doesn't appear in gatherer, maybe because he was a promo card? And not actually in the decks?
friarsol
Global Moderator
 
Posts: 7593
Joined: 15 May 2010, 04:20
Has thanked: 243 times
Been thanked: 965 times

Re: mtg-data.txt db faults =(

Postby myk » 09 Mar 2013, 15:20

friarsol wrote:I think following what Gatherer abbreviations for sets to is a bad idea anyway, since it could lead to the issue where we're forced to create an inaccessible folder in Windows. (this is why we don't have CON as the Conflux folder name)
I am actually doing some work on the res/pics/ folder layout in my branch. I was experimenting with making our layout match MWS folder layout so we could simplify the file lookup algorithms and unify the filename generation algorithms. Is this a good idea? I have to write migration code to move the files from <progDir>/res/pics/ to <cacheDir>/pics/cards/ anyway, so it seemed like an opportune time to make changes like this.

@marc: the filenames in the new fpics/HOP/ directory are not base64-encoded, so they're not quite accessible yet.
myk
 
Posts: 439
Joined: 17 Jan 2013, 02:39
Location: California
Has thanked: 38 times
Been thanked: 57 times

Re: mtg-data.txt db faults =(

Postby friarsol » 09 Mar 2013, 15:43

myk wrote:@marc: the filenames in the new fpics/HOP/ directory are not base64-encoded, so they're not quite accessible yet.
We don't really need duplicate files here, we could just have a symlink for the HOP folder to point to the old Planechase folder.
friarsol
Global Moderator
 
Posts: 7593
Joined: 15 May 2010, 04:20
Has thanked: 243 times
Been thanked: 965 times

Re: mtg-data.txt db faults =(

Postby moomarc » 09 Mar 2013, 16:18

friarsol wrote:
myk wrote:@marc: the filenames in the new fpics/HOP/ directory are not base64-encoded, so they're not quite accessible yet.
We don't really need duplicate files here, we could just have a symlink for the HOP folder to point to the old Planechase folder.
Oops, Hadn't realised that there was already a PLC folder. I can easily just rename that to HOP if that would make life easier. Although I might just stick to the new ones I uploaded and just encode them. The quality is a bit better without pushing the file size too high and the planes are decently cropped to avoid white corners from appearing. So are we using HOP or PLC as the extension?
-Marc
User avatar
moomarc
Pixel Commander
 
Posts: 2091
Joined: 04 Jun 2010, 15:22
Location: Johannesburg, South Africa
Has thanked: 371 times
Been thanked: 372 times

Re: mtg-data.txt db faults =(

Postby myk » 09 Mar 2013, 16:23

PLC is the Planar Chaos expansion, isn't it? At least according to our setdata.txt:
Code: Select all
$ grep PLC setdata.txt
Code2:PLC|Code3:PLC|Type:Expansion|Name:Planar Chaos
$ grep HOP setdata.txt
Code2:HOP|Code3:HOP|Type:Other|Name:Planechase
myk
 
Posts: 439
Joined: 17 Jan 2013, 02:39
Location: California
Has thanked: 38 times
Been thanked: 57 times

Re: mtg-data.txt db faults =(

Postby moomarc » 09 Mar 2013, 16:35

myk wrote:PLC is the Planar Chaos expansion, isn't it? At least according to our setdata.txt:
Code: Select all
$ grep PLC setdata.txt
Code2:PLC|Code3:PLC|Type:Expansion|Name:Planar Chaos
$ grep HOP setdata.txt
Code2:HOP|Code3:HOP|Type:Other|Name:Planechase
Oh right #-o I knew that. So which old Planechase folder was the good friar referring to then? There's no PCH folder on Cardforge, so maybe he was just referring to a local folder named something other than HOP? Could you clarify please Sol.

On a side note, is it not worth adding PLC as Code:2 or as an alias for HOP in SetData. Then if someone does bring in the folder named that, they don't have to rename it?
-Marc
User avatar
moomarc
Pixel Commander
 
Posts: 2091
Joined: 04 Jun 2010, 15:22
Location: Johannesburg, South Africa
Has thanked: 371 times
Been thanked: 372 times

Re: mtg-data.txt db faults =(

Postby myk » 09 Mar 2013, 16:52

+1 on the alias. Also, what is the correct name for Assault // Battery's pic? By "correct", I mean MWS-compliant. It's on the server as base64("Assault Battery.full.jpg"), but our code looks for it at base64("AssaultBattery.full.jpg").
Last edited by myk on 09 Mar 2013, 16:59, edited 1 time in total.
myk
 
Posts: 439
Joined: 17 Jan 2013, 02:39
Location: California
Has thanked: 38 times
Been thanked: 57 times

Re: mtg-data.txt db faults =(

Postby Agetian » 09 Mar 2013, 16:59

@ myk: All other split cards follow the pattern LeftsplitRightsplit.full.jpg, as in FireIce.full.jpg, NightDay.full.jpg, etc., so I assume it should be AssaultBattery.full.jpg.

- Agetian
Agetian
Programmer
 
Posts: 3490
Joined: 14 Mar 2011, 05:58
Has thanked: 684 times
Been thanked: 572 times

Re: mtg-data.txt db faults =(

Postby myk » 09 Mar 2013, 17:03

confirmed -- I just checked in the HQ pics torrent:
Code: Select all
$ for fname in *; do unzip -l $fname; done | grep Assault.*Battery
    40808  12-24-1996 23:32   IN/AssaultBattery.full.jpg
   200606  12-24-1996 23:32   TSB/AssaultBattery.full.jpg
Edit: Looks like there's a similar problem in ARC. ARC/WaxWane.full.jpg is named V2F4IFdhbmUuZnVsbC5qcGc ("Wax Wane.full.jpg") instead of V2F4V2FuZS5mdWxsLmpwZw

Edit2: The issue for the vanguard pics seems to be that those cards have SetInfo:VAN Special x2, so we look for cardname1.full.jpg and cardname2.full.jpg, but only cardname.full.jpg appears on the server.
myk
 
Posts: 439
Joined: 17 Jan 2013, 02:39
Location: California
Has thanked: 38 times
Been thanked: 57 times

Re: mtg-data.txt db faults =(

Postby Max mtg » 09 Mar 2013, 19:17

So, if we do agree to use PCH set code for planechase, should patch the python script settings like this:
Code: Select all
Index: res/mtgdata-sets-to-forge.txt
===================================================================
--- res/mtgdata-sets-to-forge.txt   (revision 20198)
+++ res/mtgdata-sets-to-forge.txt   (working copy)
@@ -54,7 +54,7 @@
 GU ULG # Urza's Legacy
 ===H09 # Premium Deck Series: Slivers
 HM HML # Homelands
-===HOP # Planechase
+HOP PCH # Planechase
 IA ICE # Ice Age
 IN INV # Invasion
 ===ISD # Innistrad
and patch setdata.txt as well.
Code: Select all
Code2:PCH|Code3:PCH|Type:Other|Name:Planechase|Alias:HOP
@Myk, I have also faced that names problem. Don't know which names are canonical (with a space between words or without one) So I just choose one option.
Single class for single responsibility.
Max mtg
Programmer
 
Posts: 1997
Joined: 02 Jul 2011, 14:26
Has thanked: 173 times
Been thanked: 334 times

Re: mtg-data.txt db faults =(

Postby friarsol » 12 Mar 2013, 19:21

Looks like arch just posted a fix for mtg-data file including split cards

viewtopic.php?f=27&t=1347#p112230

I won't be able to update the file till tomorrow night sometime, so if someone can upload, that'd be great.
friarsol
Global Moderator
 
Posts: 7593
Joined: 15 May 2010, 04:20
Has thanked: 243 times
Been thanked: 965 times

PreviousNext

Return to Developer's Corner

Who is online

Users browsing this forum: No registered users and 16 guests

Main Menu

User Menu

Our Partners


Who is online

In total there are 16 users online :: 0 registered, 0 hidden and 16 guests (based on users active over the past 10 minutes)
Most users ever online was 9298 on 10 Oct 2025, 12:54

Users browsing this forum: No registered users and 16 guests

Login Form