Collectible Card Game Headquarters

Arch wrote:Sometimes I wonder if their internal data is as inconsistent or if they're intentionally obfuscating it when adding to gatherer...

I'd vote for intentional obfuscation. Haven't you noticed that sorts don't work properly? Non-matching cards are aggressively interleaved to prevent you from cutting & pasting the result from your browser. Try a sort by number or rarity sometime. You'll see they aren't in proper order.

randian wrote:Selesnya Sanctuary is missing metadata for PC2.

Do you have the latest version of the zip? It's on line 129828 in meta.xml

What about the (snow) basic lands. Shouldnt they have regular reminder text in brackets? They are only saying W, U, B, R, G...

PilotPirx wrote:What about the (snow) basic lands. Shouldnt they have regular reminder text in brackets? They are only saying W, U, B, R, G...

That wouldn't match regular basic lands, which don't have reminder text. The "W", "U", "B", "R", and "G" are meant to represent the giant mana symbols all basic lands have these days... including snow-covered ones.

Actually I don't think there should be any rules for basic lands. The comprehensive rules states that they have the intrinsic rule of "{T}: Add {mana} to your manapool." WUBRG doesn't mean anything in this case and should be removed. I'll add (remove) that for the next release.

Gatherer should get M13 update in about six hours...

I wrote a crawler for Gatherer (Java). We are using it for the MAGE project. Currently it's in the same repository as MAGE but I plan to extract it out as a standalone project. Even if it's not large by itself it is something that might be of interest to more people. If anyone is interested please let me know.

I think it's worth to mention that it extracts all the data from Gatherer (except for colors on the double faced cards).

that would be interesting! I did a visitor for card data, it would be cool to integrate them. currently there's an adapter to read from arch's Magic Data, and I'm going to put the project online this evening. are you using Maven?

M13 is in Gatherer now, just saying

To anybody who wants data exactly as it is in Gatherer, I'm going to point out my thread that is buried under the Pictures/Utilities forum - viewtopic.php?f=96&t=3371
This doesn't have to be used for pictures at all, it can just save 100% of all card information for any language, into a single huge file in a variety of formats (XML, CSV, C++, PHP, JSON). It does not share the same goal as Arch's hand-optimized magic data though, so the end results of the database you get are going to be quite a bit different.

Yeah, the Pictures/Utilities forum is kind of buried. I'm open to suggestions...since gatherer crawling is so popular (right up there with deck building) maybe it should have a top level forum?

I'm not sure if it would flourish, but if It's going to happen, I'd suggest something like "Magic data sources". it would be a place for web crawling, data representation, transformation and analysis, etc. and would not be limited to cards, although that's the most obvious.
That said, the General Programming forum didn't really take off either, so I'm not sure It's worth it.

That's a good idea. Anyway, we never know what's going to happen until we try, and I'm always open to more suggestions.

Updated first post.

Huggybaby wrote:Yeah, the Pictures/Utilities forum is kind of buried. I'm open to suggestions...since gatherer crawling is so popular (right up there with deck building) maybe it should have a top level forum?

Not sure about a crawler forum but it would be nice to have a "Magic resource page" that points to various mtg related resources. Guess the simplest version would be a thread with some links. As a developer it would be nice to have a summary of what resources are available, differences between them and so on.