It is currently 16 Apr 2024, 08:10
   
Text Size

MTG Gatherer Extractor v3.5.1 (Database and Pics Assistant)

Moderator: CCGHQ Admins

MTG Gatherer Extractor v3.5.1 (Database and Pics Assistant)

Postby chaudakh » 17 Feb 2011, 17:26

Image

Hello !

Here is the new bêta version (3.1) of my software "Gatherer Extractor", which can easily be downloaded at the following URL:

——————————————————————————————————————————————————————————————————
http://www.mediafire.com/?3akc6mtapnar2
——————————————————————————————————————————————————————————————————

The software helps you to:

— Get a full or partial MtG Database. The software gathers information from gatherer.wizards.com and magiccards.info.
The card database can be saved as CSV or XML.
I could see that many people are looking for MtG Database for personal websites or applications. Here is a good tool to get it!

— Get a MWS Text Spoiler for home-made sets, as long as the original CSV file is correctly formated for Gatherer Extractor

— Get card scans in the language of your choice, and in the format of your choice (original, fullscan, cropped), and save them on your computer.
The source website can be chosen by the users, so that are accessible low quality scans from the Gatherer, and semi-HQ scans from magiccards.info (English only)

— Compile a Spoiler List text file for MagicWorkstation. Very useful to get a clean and bug-free spoiler text with correct formating.

—————————————————————————————
Requirements :
—————————————————————————————
— OS : Windows XP, Vista or 7.
— Microsoft Framework .NET 4
— Screen resolution at least 1024x768
— Execution as Administrator for Windows Vista and Windows 7.




WHAT's NEW in:

v3.2:
— Added sorting in exportation to OCTGN 2
— Added auto-updated set code and status when connecting to services
— Fixed minor bugs


v3.1:
— Added exportation to OCTGN 2
— Added card scan extraction by numbers
— Fixed minor bugs

v3.0:
— Improved User Interface
— Enhanced scan extraction
— Improved scan status visualization
— Wise card addition when updating database or scans
— Added autoconnect on startup
— Added autosave for database recovering
— Added scan and database extractions in a single click
— Added low-mid-high pricing extraction from magiccards.info
— Added Phyrexian mana support
— Implemented sortable database
— Fixed bug in XML export with xml-special characters
— Fixed processing of generated mana
— Fixed bug extraction of card number
— Fixed bug extraction of ruling
— Fixed bug in saving scans by name with special characters in their names
— Separated abort/reset buttons
— Recoded program from scratch

V2.2:
— Fixed extraction numbers of textless [ZEN] Basic lands
— Fixed extraction numbers of [CHK] Brothers Yamazaki
— Fixed extraction mana cost of [PRE] Ajani Vengeant
— Fixed extraction bug of Duel Decks editions (extra tokens)
— Added Russian translation (thanks dotsa83!)
— Added Brazilian Portuguese translation (thanks rpgmem!)

V2.1:
— Fixed extraction bug with flipping cards
— Fixed extraction bug of B.F.M. (Big Fury Master
— Fixed extraction bug of */* creatures from magiccards.info

V2.0 :
— Enabled multilingual software
— Enabled *.xml export with customizable xml marks
— Enabled spoiler list export for Magic Workstation (MWS)
— Added remaining & elapsed timer when processing
— Created automatic processing for all promotional sets
— Enabled extraction of spacial types (schemes, planes)
— Added extraction of card names in foreign languages
— Enabled automatic detection of cards which may generate mana: generated colors are reported in a special column
— Enabled automatic computation of card colors
— Added extraction of the card numbers
— Added extraction from magiccards.info
— Enabled sizable window
— Added automatic switching between the different web sources, when scans are not available on the chosen website.
— Added scan-downloading status column.




For those interested in, it is possible to add others supported languages. Translate directly EN.lang into a target foreign language and add the new .lang file into the "/data/language" folder!

Please let me know if you translate the software in another foreign language, so that I can add your translation to the further versions!

Enjoy, and feel free to report bugs, post comment, and to suggest improvement!


Some screenshots:

Overview of the software while downloading data | Open
Image


Overview of the software while downloading scans | Open
Image


Overview of the option menu | Open
Image


Overview of the downloaded database | Open
Image
Last edited by chaudakh on 27 Apr 2012, 17:55, edited 15 times in total.
User avatar
chaudakh
Programmer
 
Posts: 52
Joined: 03 Sep 2008, 11:35
Location: Lyon, France
Has thanked: 0 time
Been thanked: 12 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby Huggybaby » 18 Feb 2011, 01:32

What a great utility, thanks chaudakh.

BTW, I'd really appreciate an installerless portable version!

When I open the Options box and close it, and I get
Image

When I try to download images I get
Image
User avatar
Huggybaby
Administrator
 
Posts: 3205
Joined: 15 Jan 2006, 19:44
Location: Finally out of Atlanta
Has thanked: 696 times
Been thanked: 594 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby chaudakh » 18 Feb 2011, 08:41

I really thank you for reporting bugs, Huggybaby.

For the 1st bug, the access to the special-char file is denied. Are you sure you ran the application as an Administrator ? It seeems you don't have permission to write into the file.

Concerning the 2nd bug, could you please describe precisely how you obtained the error? It would really help to find and debug the problem.

Thanks in advance!
User avatar
chaudakh
Programmer
 
Posts: 52
Joined: 03 Sep 2008, 11:35
Location: Lyon, France
Has thanked: 0 time
Been thanked: 12 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby woogerboy21 » 18 Feb 2011, 13:35

This looks like a very interesting application however I want to point out that when I open the application up I am unable to view all the display due to the UI not properly resizing when adjusted. I have a monitor that runs in a fairly odd resolution (1377x768) and it appears that your UI does not adjust when you change the window size. Is there anyway to actually get the UI components to shrink and grow properly when the window is adjusted? For example it seems like I can not see everything on the right or bottom of the UI. All I can see down to is 1/2 to 3/4 of the "overall" progress bar. I am not sure if there is buttons below that or not.

Screenshots:
| Open
Clipboard01.jpg
Clipboard01.jpg (3.53 KiB) Viewed 19866 times
Clipboard02.jpg
User avatar
woogerboy21
HQ Team Member
 
Posts: 1136
Joined: 19 Jul 2009, 00:15
Location: USA
Has thanked: 21 times
Been thanked: 152 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby chaudakh » 18 Feb 2011, 13:50

The UI should ajust when you modify the size of the window. At opening, the original size is 1024 x 771, which is the minimum size of the window (for display reasons, such as a decent ComboBox for the set choices or for the DataGridView of the processed cards).

All the bugs might come from the fact that your maximum resolution is minimum than the minimum resolution required for the application, or you don't use version 4.0 of the MS Framework .NET. With your current resolution, you might miss the 3 pixels down the overall progressbar. You will miss even more pixels if your taskbar visibility is set as "always". You will miss all the timers and further information about the current treatment.

I can obviously make the minimum window size a bit smaller, but please make sure you use version 4.0 of the MS Framework .NET first. It really seems clientsize is interpreated as windowsize.
Last edited by chaudakh on 18 Feb 2011, 13:58, edited 1 time in total.
User avatar
chaudakh
Programmer
 
Posts: 52
Joined: 03 Sep 2008, 11:35
Location: Lyon, France
Has thanked: 0 time
Been thanked: 12 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby woogerboy21 » 18 Feb 2011, 13:57

chaudakh wrote:The UI should ajust when you modify the size of the window. At opening, the original size is 1024 x 771, which is the minimum size of the windows (for display reasons, like a decent ComboBox for the set choices and for the DataGridView of the processed cards).

All the bugs might come from the fact that your maximum resolution is minimum than the minimum resolution required for the application. With your current resolution, you might miss the 3 pixels down the overall progressbar. You will miss even more pixels if your taskbar visibility is set as "always". You will miss all the timers and further information about the current treatment.

I can obviously make the minimum window size a bit smaller.
I'll have to see if I can run this application on a normal monitor somewere. I attached screenshots of the application running and the UI components just seem like there in odd locations when I maximize the window. And when I resize the window to something smaller than maximized the UI components do not appear to adjust, parts just simply arent shown rather than shrinking or growing like I would expect them to. Take a look at the screenshots I attached on my first post. You will see for example the startup screen looks shorter than it should. As well as on the main screen the right boxes that are one ontop the other (one labeled sets to process and the box below it are not properly aligned). And as mentioned when the window is adjusted its not like the box sizes shrink or grow they just stay set at a given size and parts of them simply are not shown in the window.

edit:
checking the .net configuration of this machine....
Last edited by woogerboy21 on 18 Feb 2011, 14:09, edited 1 time in total.
User avatar
woogerboy21
HQ Team Member
 
Posts: 1136
Joined: 19 Jul 2009, 00:15
Location: USA
Has thanked: 21 times
Been thanked: 152 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby woogerboy21 » 18 Feb 2011, 14:04

Just double checked. MS .net 4.0 Framework is installed so it's not that.
User avatar
woogerboy21
HQ Team Member
 
Posts: 1136
Joined: 19 Jul 2009, 00:15
Location: USA
Has thanked: 21 times
Been thanked: 152 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby chaudakh » 18 Feb 2011, 14:26

The problem may come from ClientSize and Size.
I set the size of my UI at 1024x771. But you might have a bigger window captionbar and/or window border, so that the ClientSize is different between you and I.
In the same way, I impose the size of the Connectivity test window.

That would explain even the difference in the Connectivity test window.

Edit: I uploaded a new version in which that ClientSize/Size bug should be fixed/ Please tell me if it's really the case.
Last edited by chaudakh on 18 Feb 2011, 14:41, edited 1 time in total.
User avatar
chaudakh
Programmer
 
Posts: 52
Joined: 03 Sep 2008, 11:35
Location: Lyon, France
Has thanked: 0 time
Been thanked: 12 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby Huggybaby » 18 Feb 2011, 14:40

chaudakh,

I ran the app as administrator (I wasn't before, d'oh) and things are fine, no errors yet.

Due to a recent PC infection, I've been running my Win 7 with UAC turned to max. For the first couple of years I had UAC turned off so I'm not really used to it.

I'm used to getting an error message when a program expects certain permissions but doesn't find them. I don't know if MTG Gatherer Extractor can check for permissions or not.

OK, a new error. After successfully downloading data for any set, I click "Download scans" and I get:

Code: Select all
************** Exception Text **************
System.NullReferenceException: Object reference not set to an instance of an object.
   at Gatherer_Extractor.FenetrePrincipale.BWkMAJPict_ProgressChanged(Object sender, ProgressChangedEventArgs e)


************** Loaded Assemblies **************
mscorlib
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.1 (RTMRel.030319-0100)
    CodeBase: file:///C:/Windows/Microsoft.NET/Framework64/v4.0.30319/mscorlib.dll
----------------------------------------
Gatherer Extractor
    Assembly Version: 1.0.0.0
    Win32 Version: 1.0.0.0
    CodeBase: file:///C:/Program%20Files%20(x86)/Gatherer%20Extractor/Gatherer%20Extractor.exe
----------------------------------------
Microsoft.VisualBasic
    Assembly Version: 10.0.0.0
    Win32 Version: 10.0.30319.1 built by: RTMRel
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/Microsoft.VisualBasic/v4.0_10.0.0.0__b03f5f7f11d50a3a/Microsoft.VisualBasic.dll
----------------------------------------
System
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.1 built by: RTMRel
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System/v4.0_4.0.0.0__b77a5c561934e089/System.dll
----------------------------------------
System.Core
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.1 built by: RTMRel
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Core/v4.0_4.0.0.0__b77a5c561934e089/System.Core.dll
----------------------------------------
System.Windows.Forms
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.1 built by: RTMRel
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Windows.Forms/v4.0_4.0.0.0__b77a5c561934e089/System.Windows.Forms.dll
----------------------------------------
System.Drawing
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.1 built by: RTMRel
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Drawing/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Drawing.dll
----------------------------------------
System.Runtime.Remoting
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.1 (RTMRel.030319-0100)
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Runtime.Remoting/v4.0_4.0.0.0__b77a5c561934e089/System.Runtime.Remoting.dll
----------------------------------------
System.Configuration
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.1 (RTMRel.030319-0100)
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Configuration/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Configuration.dll
----------------------------------------
System.Xml
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.1 built by: RTMRel
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Xml/v4.0_4.0.0.0__b77a5c561934e089/System.Xml.dll
----------------------------------------

************** JIT Debugging **************
To enable just-in-time (JIT) debugging, the .config file for this
application or computer (machine.config) must have the
jitDebugging value set in the system.windows.forms section.
The application must also be compiled with debugging
enabled.
For example:

<configuration>
<system.windows.forms jitDebugging="true" />
</configuration>

When JIT debugging is enabled, any unhandled exception
will be sent to the JIT debugger registered on the computer
rather than be handled by this dialog box.
User avatar
Huggybaby
Administrator
 
Posts: 3205
Joined: 15 Jan 2006, 19:44
Location: Finally out of Atlanta
Has thanked: 696 times
Been thanked: 594 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby chaudakh » 18 Feb 2011, 14:46

Huggybaby,

I spent the morning modifying the scan download procedure, because I also noticed an error when trying to get scans from magiccards.info without extracting all the additional card information (in particular the Card number # in the set). Please download the new uploaded version and tell me if you still encounter that error.
User avatar
chaudakh
Programmer
 
Posts: 52
Joined: 03 Sep 2008, 11:35
Location: Lyon, France
Has thanked: 0 time
Been thanked: 12 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby Huggybaby » 18 Feb 2011, 15:29

We're making progress. :) Now I get no pics, but red arrows in the stat column.

BTW, I don't see a way to select between gatherer and magiccards.info.
I don't see a way to turn off languages besides English.
The abort button takes a long time to work, it seems to wait for everything to download first rather than interrupting the process.
User avatar
Huggybaby
Administrator
 
Posts: 3205
Joined: 15 Jan 2006, 19:44
Location: Finally out of Atlanta
Has thanked: 696 times
Been thanked: 594 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby chaudakh » 18 Feb 2011, 15:47

You can find everything concerning Scan sources and Scans in general in the Options menu, Scan tab.

I don't understand why you cannot download scans. The red arrow indicates that the download has been aborted because no picture could be found. Did you allow Gatherer Extractor in your firewall to get access to the Internet?
User avatar
chaudakh
Programmer
 
Posts: 52
Joined: 03 Sep 2008, 11:35
Location: Lyon, France
Has thanked: 0 time
Been thanked: 12 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby Huggybaby » 18 Feb 2011, 20:25

I got it working, it's not a firewall issue---I had to choose a scan source.

Suggestion: make the scan source default to Wizards and not a null value that throws an error. 8-[
User avatar
Huggybaby
Administrator
 
Posts: 3205
Joined: 15 Jan 2006, 19:44
Location: Finally out of Atlanta
Has thanked: 696 times
Been thanked: 594 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby chaudakh » 18 Feb 2011, 20:27

Default source is supposed to be gatherer.wizards ... I dont understand why your default value was nothing. Maybe you corrupted the option file due to previous "access denied".
Last edited by chaudakh on 18 Feb 2011, 22:27, edited 1 time in total.
User avatar
chaudakh
Programmer
 
Posts: 52
Joined: 03 Sep 2008, 11:35
Location: Lyon, France
Has thanked: 0 time
Been thanked: 12 times

Re: MTG Gatherer Extractor (Database and Pics Assistant)

Postby Huggybaby » 18 Feb 2011, 20:43

That's probably it, cool then.
User avatar
Huggybaby
Administrator
 
Posts: 3205
Joined: 15 Jan 2006, 19:44
Location: Finally out of Atlanta
Has thanked: 696 times
Been thanked: 594 times

Next

Return to Utilities

Who is online

Users browsing this forum: No registered users and 3 guests


Who is online

In total there are 3 users online :: 0 registered, 0 hidden and 3 guests (based on users active over the past 10 minutes)
Most users ever online was 4143 on 23 Jan 2024, 08:21

Users browsing this forum: No registered users and 3 guests

Login Form