It is currently 20 Apr 2024, 04:15
   
Text Size

Gatherer Downloader App (v1.6.8) [hq pics / card database]

General Discussion of the Intricacies

Moderator: CCGHQ Admins

Re: Gatherer Downloader App (v1.5.0) [hq pics / card databas

Postby Ark » 06 Jul 2012, 15:33

Is there any way the admins can mirror this thread to the "Magic Rules Engine Programming" area. This program does two things in one - fetching all the pictures is only half of what it can do. Other people who just want to scrape all the card data from Gatherer may want it, but they won't be looking in Pictures -> Utilities.
User avatar
Ark
Programmer
 
Posts: 350
Joined: 16 Jul 2008, 04:29
Has thanked: 10 times
Been thanked: 103 times

Re: Gatherer Downloader App (v1.5.1) [hq pics / card databas

Postby Ark » 06 Jul 2012, 15:44

v1.5.1 posted at http://ark42.com/mtg/progs/GathererDownloader-1.5.1.zip
Added up through Magic 2013 to the default set list.
Added the Phyrexian mana symbols to the default symbol list.
User avatar
Ark
Programmer
 
Posts: 350
Joined: 16 Jul 2008, 04:29
Has thanked: 10 times
Been thanked: 103 times

Re: Gatherer Downloader App (v1.5.1) [hq pics / card databas

Postby Ark » 09 Jul 2012, 19:53

English databases in file each format, for all cards from all sets (up to Magic 2013) with all card information, are now available at: http://ark42.com/mtg/MTGCardInfo/
I don't know if anybody really uses these pre-downloaded databases, but it takes several hours to fetch all the info for all sets.
User avatar
Ark
Programmer
 
Posts: 350
Joined: 16 Jul 2008, 04:29
Has thanked: 10 times
Been thanked: 103 times

Re: Gatherer Downloader App (v1.5.1) [hq pics / card databas

Postby vesuvanduquesne » 08 Aug 2012, 20:03

This is the application I've always dreamed about writing, and now it's right here! This application is awesome! And the export to PHP array is simply genius! Hopefully this application is supported forever!
vesuvanduquesne
 
Posts: 34
Joined: 06 Oct 2008, 16:26
Has thanked: 67 times
Been thanked: 2 times

Re: Gatherer Downloader App (v1.6.0) [hq pics / card databas

Postby Ark » 07 Sep 2012, 01:51

v1.6.0 posted at http://ark42.com/mtg/progs/GathererDownloader-1.6.0.zip
Added up through From The Vault: Realms, and the MTG Commander sets to the default set list.
Fixed bugs in the Rulings extraction (missed rulings on double-faced cards, and cut-out card names because of poor HTML on Wizard's site)
Added SQLite and Java class formats as options to save the card database to, though Java class isn't very useful for more than about 8-9 sets worth of data, because of string literal limitations in Java.
User avatar
Ark
Programmer
 
Posts: 350
Joined: 16 Jul 2008, 04:29
Has thanked: 10 times
Been thanked: 103 times

Re: Gatherer Downloader App (v1.6.0) [hq pics / card databas

Postby Ark » 07 Sep 2012, 04:15

New, a homepage for the program, that basically mirrors all the info I post here anyway - http://ark42.com/mtg/gathererdownloader/
User avatar
Ark
Programmer
 
Posts: 350
Joined: 16 Jul 2008, 04:29
Has thanked: 10 times
Been thanked: 103 times

Re: Gatherer Downloader App (v1.6.0) [hq pics / card databas

Postby sandman423 » 12 Sep 2012, 08:45

This might be the wrong place to post...But could someone help me...

I d/l mtg renamer 1.6.0

Then I opened it...

Selected Set...Planechase 2012 then clicked D/L Card Database..

Then on the bottom I selected D/L card images...Then I selected Card Database D/L Saved it as PC2.xml

Then I opened MTG Renamer & Downloader v1.0.5 to import DB...Then on the bottom I select Source:Wagic Destination:Wagic....Sets: Planechase 2012 is Checked.

Then when I hit Copy and Download and then it only gives me the tokens...

How do I get this to work for Wagic?

Any ideas? Sorry if it is in the wrong place.
sandman423
 
Posts: 93
Joined: 14 Sep 2009, 03:00
Has thanked: 0 time
Been thanked: 0 time

Re: Gatherer Downloader App (v1.6.1) [hq pics / card databas

Postby Ark » 26 Sep 2012, 15:37

v1.6.1 posted at http://ark42.com/mtg/gathererdownloader ... -1.6.1.zip
Added Izzet vs. Golgari and Return to Ravnica to the default set list.
User avatar
Ark
Programmer
 
Posts: 350
Joined: 16 Jul 2008, 04:29
Has thanked: 10 times
Been thanked: 103 times

Re: Gatherer Downloader App (v1.6.1) [hq pics / card databas

Postby sandman423 » 10 Oct 2012, 00:24

How do I get the New Return to Ravnica to show up in The Gatherer 1.6.1??

I d/L 1.6.1
and also
MTGCardInfo (Return to Ravnica).zip

I unzipped MTGCardInfo File into The Gatherer 1.6.1 folder and then I opened the Gatherer and Chose File>Open Card Database>Chose MTGCardinfo (Return to Ravnica)

And it doesn't showup on the dropdown menu...

How Do I get this to work?
sandman423
 
Posts: 93
Joined: 14 Sep 2009, 03:00
Has thanked: 0 time
Been thanked: 0 time

Re: Gatherer Downloader App (v1.6.1) [hq pics / card databas

Postby skibulk » 10 Oct 2012, 01:00

@sandman423
Try from the menu: Edit > Edit Set List > Load Defaults.

@Ark
I just noticed that Wizards has slightly larger images in their Visual Spoilers than in Gatherer. Can you hookup Gatherer Downloader to download them? (Mostly useful for foreign sets) The Core / Expansion Sets after Shards of Alara plus Commander feature images sized 265 x 370 - in each language printed! (First set your language preference at the bottom of the page.) Gatherer features images sized 223 x 310 - a 15% difference. Not to mention that Gatherer doesn't have any foreign card data for Return to Ravnica yet; the foreign images are however included in the Visual Spoilers. Check it out.
User avatar
skibulk
HQ Team Member
 
Posts: 995
Joined: 19 Jul 2010, 20:34
Location: Northeast USA
Has thanked: 379 times
Been thanked: 335 times

Re: Gatherer Downloader App (v1.6.1) [hq pics / card databas

Postby sandman423 » 10 Oct 2012, 01:51

Thanks Skibulk it worked...

Now how do I get it to rename the files to drop .full. I am trying to use MTG Renamer but it keeps not working..I Got Card Images & Database but why isn't Golgari vs Izzet Renaming not working...

It worked for Return to Ravnica?

It keeps just giving me tokens...Not cards are getting renamed.

How do I get it to work?

the bottom options I change them to Wagic to Wagic or MagicAlbum to Wagic.
sandman423
 
Posts: 93
Joined: 14 Sep 2009, 03:00
Has thanked: 0 time
Been thanked: 0 time

Re: Gatherer Downloader App (v1.6.1) [hq pics / card databas

Postby skibulk » 10 Oct 2012, 15:42

@sandman423
If you're having an issue with MTG Renamer, you should post it to the thread for that program; this thread is for Gatherer Downloader. You could try Advanced Renamer Portable for simply removing the ".full" extension.
User avatar
skibulk
HQ Team Member
 
Posts: 995
Joined: 19 Jul 2010, 20:34
Location: Northeast USA
Has thanked: 379 times
Been thanked: 335 times

Re: Gatherer Downloader App (v1.6.1) [hq pics / card databas

Postby Ark » 10 Oct 2012, 15:44

Or you know, just use the option in Gatherer Downloader to not put the .full in the name to begin with....
User avatar
Ark
Programmer
 
Posts: 350
Joined: 16 Jul 2008, 04:29
Has thanked: 10 times
Been thanked: 103 times

Re: Gatherer Downloader App (v1.6.1) [hq pics / card databas

Postby Ark » 10 Oct 2012, 15:46

@skibulk
I hate the Visual Spoiler.. there is no way to map the filenames to what card they're supposed to be for:
Code: Select all
http://media.wizards.com/images/magic/tcg/products/rtr/06d5o9l1b0_en.jpg
Yeah, I can map the 'rtr' bit, and the '_en' bit, but 06d5o9l1b0 doesn't mean "Angel of Serenity" in any useful way.

For reference, the Gatherer image is at:
Code: Select all
http://gatherer.wizards.com/Handlers/Image.ashx?multiverseid=253627&type=card
And the 253627 ID is easy, because all the other Gatherer pages reference the multiverseid as a unique card identifier.
User avatar
Ark
Programmer
 
Posts: 350
Joined: 16 Jul 2008, 04:29
Has thanked: 10 times
Been thanked: 103 times

Re: Gatherer Downloader App (v1.6.1) [hq pics / card databas

Postby skibulk » 10 Oct 2012, 15:51

@Ark
The cards are ordered by collector's number though - so a simple mapping of card names from the Gatherer data to their respective position on the page should do the trick?
User avatar
skibulk
HQ Team Member
 
Posts: 995
Joined: 19 Jul 2010, 20:34
Location: Northeast USA
Has thanked: 379 times
Been thanked: 335 times

PreviousNext

Return to Magic Rules Engine Programming

Who is online

Users browsing this forum: No registered users and 28 guests


Who is online

In total there are 28 users online :: 0 registered, 0 hidden and 28 guests (based on users active over the past 10 minutes)
Most users ever online was 4143 on 23 Jan 2024, 08:21

Users browsing this forum: No registered users and 28 guests

Login Form